The role of DataOps engineer is on the rise.
As more organizations adopt an analytics approach to decision-making, the amount of data they accumulate can often be overwhelming. As a result, in recent years data-driven organizations have developed methodologies for managing their data, methodologies loosely lumped together under the umbrella term DataOps, which is short for data operations.
Someone, however, is needed to coordinate those DataOps to ensure that their organization’s data is properly managed and developed so that it’s trustworthy when ready for consumption, and just within the last couple of years that has led to the advent of the DataOps engineer.
Often former software engineers with experience in DevOps — the collaborative approach to application development and IT operations — DataOps engineers work with data scientists and data engineers to make sure that data is properly managed throughout the analytics process.
Joe Hilleary, a research analyst at Eckerson Group, a consulting firm based in Hingham, Mass., has followed the growth of the DataOps movement within analytics, and subsequently the development of the DataOps engineer.
He recently discussed DataOps and the emerging role of DataOps engineer, including the role’s origins and how it can change what