Big Industries is proud to sponsor "Between the Clouds," an event held on October 22nd, 2024 organized by Clusity—the community for women in tech in Belgium. Clusity aims to close the gender gap in the tech industry by empowering women and providing a platform for them to exchange their knowledge and experiences.
At Big Industries, we share this commitment to diversity and inclusion, which is why we are happy to support Clusity's efforts to provide a platform for women in tech to connect, grow, and inspire. As a Big Data Consultant at Big Industries and an ambassador for Clusity, I, Andreia Negreira, had the privilege of participating in this inspiring panel discussion, where we explored the world of cloud computing, hybrid environments, and the future of multi-cloud strategies. Below, I share some of the highlights of the conversation.
I built my skills by working on four projects in AWS during my internship at Big Industries, each of which required using more than six different AWS services to create functional data pipelines. More recently, I earned my AWS Certified Data Engineer Associate certification. I have to say that having mentors during my internship was a major pillar in my development—they guided me on best practices and helped me make wise decisions.
I was interested in furthering my career in cloud computing and luckily, I got the chance at Big Industries to develop further my skills in the field I was passionate about: cloud computing and data engineering.
What excites me most about cloud computing is the abstraction of complexity. Cloud resources are typically fully managed, meaning you do not have to worry about the underlying infrastructure, you can focus purely on business logic. I also love the flexibility of provisioning and destroying resources as needed.
When it comes to multi-cloud, I think it really depends on the organization's needs. Sticking with one provider makes it easier to manage costs, ensure consistent governance, and build specialized skills within your team. However, if your organization requires redundancy or needs tools from different cloud providers, a multi-cloud approach can be a feasible solution.
The hybrid cloud approach is particularly popular here in Belgium. Many companies are hesitant to move entirely to the public cloud due to concerns about data privacy and control. I have seen data that suggests only around 12% of Belgian companies operate fully in the public cloud, with the majority opting for a hybrid approach. This setup allows companies to maintain control over sensitive data while leveraging the scalability and flexibility of the public cloud where appropriate.
To avoid being locked into a particular provider, it is important to build your architecture in a cloud-agnostic way. This means using open-source tools or self-hosted options rather than cloud-specific services. Infrastructure as code tools like Terraform can also help make your architecture reusable across different providers. However, being locked into a vendor is not necessarily a bad thing if you have well-trained personnel, good relationships with the vendor, and an established business.
To bridge the gap between business and tech, I think clear communication and ongoing education are key. At Big Industries, we have quarterly academy days to realign our vision and learn from each other. We also have monthly meetings to discuss progress with the business side, which helps maintain motivation and ensures that both personal and company goals are aligned.
For those interested in getting into cloud computing, I recommend selecting a provider that interests you and subscribing to its academy platform. For AWS, for example, the Skill Builder platform offers excellent labs and courses. Another great tip is to pursue an entry-level certification. I received this advice from last year's speaker, colleague and mentor, Joanna Kiesak, who emphasized the value of showcasing your development through certifications. Following her words, I pursued a certification myself, and I can see the value it brings.