The cloud is a reality in companies, so much so that public cloud spending is expected to exceed $500bn this year. And it is that, it has established itself as the main asset to grow, gain flexibility/agility, and do it with controlled costs.
On this, Keepler Data Tech has wanted to anticipate the new edition of the AWS Summit and analyze the next challenges facing the public cloud and that, without a doubt, will be a topic of conversation at the event next May.
“Providers must take advantage of this tendency and predisposition of organizations to trust the public cloud and strengthen those services and functionalities that invite to improve reliability and credibility,” explains Pablo Valiente, Principal Cloud Architect at Keepler Data Tech.
Public Cloud Trends
These are the upcoming challenges facing the public cloud:
- DataMesh: This paradigm is already occupying a lot of debate among those responsible for data in organizations. It is about adopting a decentralized data governance model, based on a distributed architecture and under the responsibility of the business areas (domains), with respect to their own data (decentralization of governance roles). Essentially, it refers to the concept of breaking down data into more robust, specialized and decentralized domains and introducing interesting concepts to the Cloud environment, such as Data Products and Data Democratization.
- Multi-account government: The management of multiple accounts is a task in which each public cloud provider offers its own tools to facilitate the work and standardize the creation mechanisms, so that good practices can be applied in an automated and verifiable way. Accounts are usually grouped into organizations, which facilitates the application of security policies to all of them equally, which facilitates the management and standardization of good practices. The difficulty lies in managing the resources of large organizations and dealing with hundreds of accounts in the same company. This is where there is room for improvement for Cloud providers, and news and advances are expected throughout this year.
DataMesh, multi-account governance, MLOps, metadata governance and security, the great challenges for public cloud providers
- MLOps is a specialization of the DevOps ecosystem, which seeks to apply automation and deployment best practices to the world of data science. In 2021, it was observed how MLOps was establishing itself as a trend for the different Cloud providers and how more and more resources were being invested to offer new tools and services, which would facilitate the work of creating and deploying data models in the public cloud. This year, LowCode tools have begun to proliferate and are beginning to become widespread in companies and it is estimated that, in 2024, 75% of them will use them, as Gartner predicts. This pace of growth and demand is forcing public cloud platforms to sharpen their focus, to avoid being left behind, so we expect to see big improvements in the realm of MLOps and LowCode tools in the coming months.
- Metadata Governance: If there is one clear point regarding the public cloud, it is that metadata management seems stuck. Companies demand not only to have control over their data, but also to govern the associated metadata, as valuable as the information itself. All public cloud providers offer very basic tools to fill this gap. But none provide a complete, robust, native solution to address this task. The demand for these capabilities in the public cloud is so high that it is forcing companies to look for third-party solutions or directly implement their own solutions, so it is expected that during 2022 and 2023 the different public cloud providers will be able to take advantage of the gap that they themselves have left and offer complete solutions for the treatment and governance of data in the public cloud.
- Security: Safety is a pillar that must always be present and in constant evolution. None of the measures or improvements proposed above would be feasible if it were not accompanied by all the necessary security measures to guarantee the protection of one of our most valuable assets, data. For this reason, investment in security is expected to grow, since it is a key and decisive point for companies to opt for moving their data to the cloud and enriching the ecosystem.
AWS Summit
The AWS Summit returns to Madrid in person, to explore the full potential of the cloud, on May 4 and 5, 2022.
George is Digismak’s reported cum editor with 13 years of experience in Journalism