Dear customers, partners, and readers, it feels like just yesterday I was writing the 2018 end-of-year blog post. And here we go again, another year has gone by and so many wonderful things have happened.
Solo Play? No Way!
I would like to begin by saying a big “Thank you!” to all our customers, partners, and others rooting for MANTA around the world. We wouldn’t have gotten to where we are if it weren’t for you. I strongly believe that no software technology can be successful, no matter how great and revolutionary it is, without visionary professionals who clearly see its value and benefits and are willing to deploy it. Your enthusiasm and eagerness for MANTA bring out the best in us and boost our motivation to deliver the greatest product and provide you with excellent service. You are our heroes and we feel honored to work with you.
We have grown by leaps and bounds in 2019, due in no small measure to your support. We doubled the total number of customers, expanded outside the United States of America and Europe to new territories in the Middle East, Asia-Pacific, and Africa, and our team grew to twice its size. But the best part is how our unified lineage platform has evolved over the past 12 months and how many new unique and powerful capabilities that enable the modernization of (meta)data management are now available to our users.
But what’s yet to come is even more exciting. We are thrilled to see how unified lineage is transforming the world of data management in our customers’ hands. Since the early days of MANTA, we have heard people talking about lineage as a component of a data governance tool or a data catalog. Lineage is traditionally seen as a map of a data environment with a mission to help with compliance and regulatory projects, or as a tool to perform faster impact analyses. And even if both use cases are extremely powerful for any type of organization, nothing could be farther from the truth. Lineage has so much more to offer, and our everyday experiences and our customers’ stories are living proof of it.
Facing the Dependencies
What is lineage really about? From the very beginning of the Information Age, there has been one critical element causing us a lot of pain—dependencies. Why pain? Because complex dependencies mean a high risk of failure, high maintenance costs, and low productivity. And the data environment is not an exception. Some dependencies are simple and under control, like primary or foreign database keys in an Oracle database. But most real-life dependencies are significantly more complex and harder to manage. Just imagine a typical data pipeline today—hundreds of Excel spreadsheets, thousands of reports, and multiple databases with millions of tables and columns connected through tons of ETL workflows in different technologies, plus custom-built Java applications and APIs. All that partially on-premises, the rest in the cloud, both batch and real-time processes.
Simply said, understanding and efficiently managing complex dependencies in your data environment is a major requirement today, and it will be even more important in the future. Lineage is the key to understanding your environment and being able to quickly and efficiently react to market needs. It allows you not only to implement a successful data governance program but also to improve all other data management processes, including data quality, security, DevOps, and master data management. Lineage helps you become even more competitive, leave your rivals far behind, and stand out as a leader.
Augmented Data Management
To better frame this state of complexity, imagine you are driving a car in a congested city.
Like when I moved from a smaller town to New York City. Cars, bikes, people everywhere. It is hard to compare to any other driving experience I’ve had in my life. I am a good driver, but the environment was too complex for me. The probability of an accident was too high, so I did what almost anyone would do—I slowed down. And that is exactly what’s happening today with data management. We slow down due to the increased complexity of our data pipeline. It affects every discipline—quality, security, master data, development, operations, and governance.
In the automotive industry, we have developed advanced driving assistance systems to beat the complexity—they help us brake if there is an object in front of the car, they help us drive safely on icy or wet roads, and they show us additional information about objects we cannot see that could be dangerous (like a person stepping out on the road on the other side of a car). To make it clear, driving assistance systems augment our driving experience to make it less risky and more convenient. And lineage does the same for data management. It augments your existing security, quality, DevOps, governance, and master data management processes to increase your productivity and reduce the risks you face.
What the Future Holds
At the beginning of this post, I mentioned that I am excited about the future of unified lineage. That is because every year I notice more and more people talking about it, realizing its true transformative potential, and, finally, implementing it. In the Gartner 2019 Top 10 Data and Analytics Trends report, augmented data management is listed among technology trends that will have a significant disruptive potential over the next three to five years. We at MANTA fully agree! The upcoming year is going to be an exciting one for the whole data industry.
My wish for all of us in 2020 is to bring the world closer together, bridge the gaps, and reach a common understanding. Just like we do with lineage, for organizations and the people working there.
Happy New Year!