Forbes recently published an article on the Age of Data Democratization, a piece about the inexorable spread of easily consumable data tools throughout organisations. One thing stood out to me - or rather, the absence of one thing: there was no mention of Network Data. This was more than a little surprising. Though companies are using many data sources for business insight, Network Data has arguably the highest intrinsic value in today’s real-time business, and is also the data source most in need of democratization.
Firstly, let’s agree what we mean by Network Data. We mean the actual packets that are travelling around your network, using various encapsulations and protocols like IP, Ethernet, MPLS, HTTP etc. We don’t mean stats gathered from routers and switches, we don’t mean NetFlow records, we don’t mean any other derived metrics, we mean all of the actual data packets and the entire L2-L7 payload.
This distinction is really important, because this packet data contains the full record of every application request and response, every customer interaction, every business transaction, every performance outage and protocol error, every security breach and every overloaded system. Flow data and network stats have their uses but simply don’t contain this level of richness.
Today, there is a tacit acceptance of the value of network data.
But network data today has some pretty significant problems: it’s mainly usable only by the network team, it’s expensive to deploy, very time-consuming to extract value from, and really only works for episodic after-the-fact investigations.
The rich content of network data makes it compelling, but it’s so difficult to use that it becomes the “data-of-last-resort,” so to speak. The vast majority of captured network data today is archived or deleted without ever being inspected by a human or a machine algorithm. Billions are invested and the data is just thrown away. What a waste.
The movement to democratize network data aims to change all that. It aims to bring network data out of the back room and finally deliver value for those billions of dollars invested.
What if every packet traversing your infrastructure were inspected, decapsulated, decrypted, decoded, reassembled, analyzed, enriched, indexed, presented, published and stored, in real time, all the time? What if it was simple to use, for anyone in the organization? What if each application and business group could see just the specific data that was important to them?
Network data would no longer be confined within the network group – there would be a continuous stream of value and insights being shared through the organization. You would gain real-time insights into all the richness contained in the network data – customer transactions, security breaches, IT performance. Easily. Automatically.
This democratization is happening. We at Corvil are part of it, but the movement goes well beyond us. The value in network data is too compelling to be ignored, and over the next 12 months we believe you’ll see more and more companies join up with this movement and tap into that value.