The advent of big data – The State’s little sister stands on the look-out.

July 1st, 2013 | Posted by Claude-Etienne Armingaud in eCommerce | France | Privacy

Big data.” For nearly a year, marketers and CRM specialists have been more than fond of this new expression to the point of devoting several special editions of their publications to the topic.

If this neologism tends to scare the general public by its phonetic and philosophical proximity with its Orwellian bigger brother, the concept only pursues the developments initiated in the 90s through “data mining.” At that time, groups of data seemingly lacking causal or correlative relationships were subjected to mathematical analysis in the hope of discovering links between aggregated individual behaviors.

While some findings were limited to stating the obvious (such as the increased sales of appetizer upon promoting aperitif drinks), these new mathematical models allowed marketing teams to quantify the actual impact of promotions within the realm of distribution.

Other findings, however, were able to uncover less obvious ties, such as a correlation between the purchase of beer and of diapers for children by male shoppers.

These new steps in consumerism were however limited by the then-existing technology: the power of computers at the time, the introduction of data into the system and the processing time made the analysis relevant solely as a background strategy and for the emergence of certain statistical behavioral typologies, but does not allow any analytical granularity, or a real-time view. In addition, costs associated with material and human resources necessary for such analyzes prevented its access to a large crowd of users.

Nearly twenty years later, while technology has evolved in accordance with Moore’s Law, the consecration of Big Data has mainly be possible thanks to a double behavioral factors from the subjects / objects of the data analysis. Indeed, the raw material of big data remains the individuals. But those individuals have not only moved their habits to a digital world, facilitating the capture of data, but also opened up to the sharing their data in this paperless world.

It would seem that this created a data paradox: people have never advertised so freely their private life and personal data and, at the same time, the proposed revision of the EU regulatory framework for the processing personal data has seen a rarely-encountered level of lobbying. And so, today, a consumer association puts the main players of the social networking sphere on the grill, demanding that they explain their abstract contractual relationships with their users. And at the same time, the same users do not seem ready to give up the online sharing of their individual moments.

In our opinion, this view is not as paradoxical as it seems. It is instead the result of the confidence that these same users in how their lives are used for other purposes than just sharing with a selected group of recipients. After all, if the service is free, the money must be found elsewhere. The aphorism goes on to state that the user should then be the product, but it could also be that the user is consciously aware of its own value in this exchange.

When the exchange appears as too unbalanced, the consumer will not hesitate to revise to the economy of this contract and leave the relationship, bringing along his value.

Trust is therefore the core engine of data analysis.

This statement may seem conclusive. However, looking at the legal and regulatory obligations bearing on those in charge of data processing, it seems clear that such obligations mainly includes good conduct and transparency undertakings, with both individuals and the regulator. For instance, the core requirements set forth by the French Data Protection Authority (CNIL, Commission Nationale de l’Informatique et des Libertés) reside primarily in disclosure requirements for individuals and reporting to a publicly accessible register maintained by the regulator.

And this is probably where the issue lies with regards to Big Data. The data sets have reached extravagant sizes and the service providers and experts are bragging loudly about their ability to assist in the navigation on these oceans of bits. If their capacity to create real value in these dizzying well, it should not be forgotten that their expertise comes from data-hungry mathematical and algorithmic models. The temptation remains to feed these models in order to increase the service providers’ relevance from the data collected on behalf of their client.

When the flow of data becomes less transparent, without the knowledge of individuals or of such service providers’ customers, the implosion of the whole system is to be expected soon.

Without questioning the actual benefits of Big Data for all CRM actors, including the customers themselves (more than happy to receive offers truly relevant to their personal interests), the chain of trust must be maintained all along in order not to break the fragile ecosystem. The best policy must reside in a rational and coordinated approach by the classical actors of a new issue, and ensure that the multiplication of “Chief Data Officers” in multiple actors do not come at the expense of “Chief Privacy Officers”, acting as a legal safeguard against marketing sirens.

Indeed, a point of no return could be reached when Big Data, surpassing Big Brother, will not even need to analyze the present behavior to predict the future. And that point of no return has been reached last year by Target.

You can follow any responses to this entry through the RSS 2.0 Responses are currently closed, but you can trackback.