/* ---- Google Analytics Code Below */

Wednesday, November 10, 2021

Thinking Streaming Data

What is a Streaming Data    In Venturebeat  By Peter Wayner .... 

Well joined the team a long time ago, so had to pause here at the question,  could imagine what it meant, despite having worked with many.   But OK ...a stream of data, often over time, but could also be data about progressive events of interest,  blocks of an the above, decisions, etc.    Also to include supporting data.  Can even included specifically selected data in sequence.   e.g.   A Log.  To support some tasks or decisions.   So taking this a bit more precisely and further.  The parts you need. 

" ... Some programmers and DBAs are developing pipelines that can accept, analyze, and store the important bits. These so-called streaming databases are tools designed to handle both the unstoppable incoming flow as well as the endless queries from tools that want to make decisions based upon the data ....  

What is a streaming database?

Streaming databases are close cousins to other new classes of tools like time-series databases or log databases. All are designed to track a series of events and enable queries that can search and produce statistical profiles of blocks of time. The streaming databases can respond to queries for data and also statistics about the data, generate reports from these queries, and populate all of the dashboards that track what’s happening to allow the users to make smart decisions about the telemetry... "

Some programmers and DBAs are developing pipelines that can accept, analyze, and store the important bits. These so-called streaming databases are tools designed to handle both the unstoppable incoming flow as well as the endless queries from tools that want to make decisions based upon the data....

So a good discussion of the basically very simple idea...


No comments: