/* ---- Google Analytics Code Below */

Wednesday, October 16, 2019

Logs are Live and Thriving

A fairly obvious point.  Via O'Reilly.    But it is precisely these logs initially established for simple statistical, fairly linear tracking, validating the operation of code and resulting UX,  that are often used today to drive data for Deep Learning.   Seen that exactly lately.    How do we define 'too much' data?    When is the derived data violating your privacy?

Logs were our lifeblood. Now they're our liability.What happens when we collect too much data?
In the beginning, writes Jay Kreps, co-founder of Confluent and co-creator of Kafka*, there was the log. 

A log is just a sequence of records ordered by time. It’s configured to allow more and more records to be appended at the end, like this:   .... 

Logs keep track of anything and everything. There are all kinds of logs in computing environments:
The ones that are important are server logs, which keep track of the computers that access the content and apps you have on the internet.

When your computer accesses a website, the server hosting that website gets - and keeps -  a bunch of details from your computer, including which resources (web pages) the computer accessed, the time the computer accessed those resources, and the IP address of the computer that accessed them.   ... " 

No comments: