Throwing Optane on Spark

Accelerate Your Apache Spark with Intel Optane DC Persistent Memory from Databricks

Spark is in-memory, cool! But that also brings with it issues. Intel sees it as a use case for its new Optane feast and fowl memory. 

On the matter of GDPR

Here are some takes from my work on the matter of GDPR at SearchDataManagement.com

https://searchdatamanagement.techtarget.com/opinion/GDPR-privacy-concerns-still-brewing-on-laws-first-birthday

https://searchdatamanagement.techtarget.com/podcast/Hadoop-data-governance-services-surface-in-wake-of-GDPR

https://searchdatamanagement.techtarget.com/opinion/GDPR-compliance-requirements-drive-new-winds-of-data-privacy

https://searchdatamanagement.techtarget.com/feature/Data-expert-GDPR-deadline-is-an-opportunity-not-a-burden

Latent ODEs for Irregularly-Sampled Time Series

"Latent ODEs for Irregularly-Sampled Time Series"

Time series with non-uniform intervals occur in many applications, and are difficult to model using standard recurrent neural networks (RNNs). These guys generalized with a model called ODE-RNNs. Paper by Rubanova et al.: arxiv.org/abs/1907.03907

AI for Good: DataRobot & Global Water Challenge

Data Brevia July 2019

Soon in theatres near you: "Cambridge Analypse" - the story of a mad professor who cruelly crashed two elections, and the plucky data scientist whistle-blower who disclosed the dirt. Starring Ethan Hawke, Sandra Dee and Paul Ruebens and Nick Nolte (as Steve Bannon). pic.twitter.com/D8SwOiLaMR

— Jack Vaughan (@JackIVaughan) July 18, 2019

Lyft open-sourced their autonomous driving dataset from its Level 5 self-driving fleet.

- 55k human-labeled 3D frames
- 7 cameras, 3 lidars
- HD spatial semantic map: lanes, crosswalks, etc
- Drivable surface maphttps://t.co/KDvvKRWX2w pic.twitter.com/uvQ8jmw2UG

— Reza Zadeh (@Reza_Zadeh) July 23, 2019

FaunaDB 2.7 with improvements for and access data control. https://t.co/84Tq62bst8

— Jack Vaughan (@JackIVaughan) July 24, 2019

Each time my comment about big data failures is repeated, the thing failing changes. This time it's data science. Last time it was AI projects. https://t.co/GqQHisRPeY

— Nick Heudecker (@nheudecker) July 24, 2019

Talend Data Fabric release supports pay-as-you-go option with Pipeline Designer, intelligent data integration with MagicFill machine-learning powered suggestions and reversible Format Preserving Encryption. https://t.co/2Uei2NrF9S

— Jack Vaughan (@JackIVaughan) July 18, 2019

Redis adds TimeSeries Module - https://t.co/d1tyfZnHWQ via @redislabs

— Jack Vaughan (@JackIVaughan) July 22, 2019

Dagster open-source library targets ETL processes and ML pipelines. https://t.co/7tVDNt9P61

— Jack Vaughan (@JackIVaughan) July 22, 2019

Some open source DBs are zigging - but Yugabyte is zagging. It goes for Apache license - which makes sense as it is looking to lure Postgres advocaters. https://t.co/TmkxBLjnHM

— Jack Vaughan (@JackIVaughan) July 20, 2019

Berners-Lee Biopic