Databricks builds out SQL Analytics for data lakehouse

Databricks is putting more substance behind its data lakehouse model, with a new SQL Analytics service, revealed Nov. 12, that is part of the company’s Unified Data Analytics Platform.

The data lakehouse is a concept that the data science and engineering vendor has been advocating over the course of 2020 as a technical architecture that combines the best elements of data lake and data warehouse models.

The technology foundation for Databricks’ vision of the lakehouse is an open source project known as Delta Lake, which is currently hosted by The Linux Foundation. In June, Databricks expanded on Delta Lake with the launch of its Delta Engine, which adds Spark 3.0-based data queries and caching to the lakehouse.

The Databricks SQL Analytics service brings Delta Engine into the Databricks platform to help customers use the lakehouse model. The new service also integrates technologies from data visualization vendor Redash, which Databricks acquired in June.

While Databricks unveiled the SQL Analytics service today, it will be available only as a preview starting Nov. 18. The vendor said it expects general availability to follow in early 2021.

Why the data lakehouse concept works

The lakehouse concept that is at the core

Continue Reading

SpaceX Crew Dragon Launch Delayed by 24 Hours Due to Bad Weather

NASA and high-tech entrepreneur Elon Musk’s rocket company SpaceX announced on Friday a 24-hour weather delay of their planned launch of four astronauts into orbit for NASA’s first full-fledged human mission using a privately owned spacecraft.

The liftoff time slipped from Saturday to Sunday evening due to forecasts of gusty, onshore winds over Florida – remnants of Tropical Storm Eta – that would have made a return landing for the Falcon 9 rocket’s reusable booster stage difficult, NASA officials said.

SpaceX’s newly designed Crew Dragon capsule, dubbed “Resilience” by its crew, was rescheduled for launch atop the Falcon 9 at 7:27pm Eastern time on Sunday (0027 GMT on Monday) from NASA’s Kennedy Space Center in Cape Canaveral.

The crew for the flight to the International Space Station includes three American astronauts – Victor Glover, Shannon Walker and the mission commander, Mike Hopkins, a US Air Force colonel who is to be sworn into the fledgling US Space Force once aboard the orbiting laboratory.

The fourth crew member is Japanese astronaut Soichi Noguchi, making his third trip to orbit after flying on the US space shuttle in 2005 and a Russian Soyuz spacecraft in 2009.

The journey to the space station

Continue Reading