Our Big Blogs

Celebrating 1Oth Anniversary: Big Industries goes Montenegro

This year we celebrated the 1Oth Anniversary of our company with an exclusive edition of our renowned Big Industries Academy ...
Read more

Getting Started with Databricks Community Edition

Databricks Community Edition is a free, cloud-based version of the Databricks platform tailored...

Read more

Between the Clouds: A Conversation on Careers and the Future of Cloud

Big Industries is proud to sponsor "Between the Clouds," an event held on October 22nd, 2024...

Read more

Advanced Optimisation Strategies for AWS Glue Jobs with Spark engine

In the world of big data, the Apache Spark engine has evolved as a keystone technology for...

Read more

A warm welcome to Esat Saglam

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

Kudos again to Francine !

Francine previously passed the AWS Certified Developer - Associate exam. She is excelling at her...

Read more

HowTo? Series: prepare for AWS Certified Data Engineer exam

With this How To? Series we want to Share Our Wisdom not only internally with our Big Industries...

Read more

Exploring Messaging and Streaming Technologies Part8: RabbitMQ

As Francine Anestis continues her deep dive into Messaging and Streaming technologies, she delves...

Read more

The MinIO Enterprise Object Store: Built for AI Data Infrastructure

Big Industries recently entered into a partnership with MinIO, the company behind the popular open...

Read more

What is work like at Big Industries?

{% video_player "embed_player" overrideable=False, type='hsvideo2', hide_playlist=True,...
Read more

Serverless Stream Data Pipeline in AWS

{% video_player "embed_player" overrideable=False, type='hsvideo2', hide_playlist=True,...
Read more

Exploring Messaging and Streaming Technologies Part7: NATS JetStream

In Francine Anestis ongoing exploration of Messaging and Streaming technologies, she immerses...

Read more

Exploring Messaging and Streaming Technologies Part6: Redpanda

In this latest installment of Francine Anestis's series on Messaging and Streaming technologies,...

Read more

dbt Explained

In the expansive world of data engineering, dbt (data build tool) has carved out a distinct niche....

Read more

Exploring Messaging and Streaming Technologies Part5: Google Pub/Sub

This is the fifth article in a series of articles by Francine Anestis, where she looks at different...

Read more

Exploring Messaging and Streaming Technologies Part4: AWS Kinesis

The fourth technology Francine Anestis is covering in the series "Exploring Messaging and...

Read more

Geospatial Big Data at Big Industries PART II: How?

Recap: why GeoMesa?

As described in an earlier post, at Big Industries we make use of...

Read more

Exploring Messaging and Streaming Technologies Part3: Azure Event Hubs

Following the series “Exploring Messaging and Streaming Technologies”, in Part 3, Francine Anestis...

Read more

Exploring Messaging and Streaming Technologies Part2: Apache Pulsar

Francine Anestis writes a series of articles about various Messaging and Streaming technologies....

Read more

Celebrating 1Oth Anniversary: Big Industries goes Montenegro

This year we celebrated the 1Oth Anniversary of our company with an exclusive edition of our...

Read more

Kudos to Jutter & Bhagavan

If you grow as an employee, the company grows as well. That’s why we decided to setup the Big...

Read more

Exploring Messaging and Streaming Technologies Part1: Apache Kafka

This is the first article in a series of articles by Francine Anestis, where she looks at...

Read more

AWS Data & Analytics Services Competency

We are thrilled to announce that Cronos, with the help of Big Industries, has been recognized by...

Read more

HowTo? Series: Prepare for AWS Certified SysOps Administrator exam

With this How To? Series we want to Share Our Wisdom not only internally with our Big Industries...

Read more

Apache NiFi Explained

Apache NiFi, a robust, scalable, and configurable data processing and distribution system, has...

Read more

Kudos to Muthiah

If you grow as an employee, the company grows as well. That’s why we decided to setup the Big...

Read more

Life at Big Industries: Interview with Morad

Interview with Morad on how it is working for Big Industries? How important are the values Share...

Read more

Big Industries partners with DBT Labs to empower Data Teams

A new collaboration that will enable Big Industries clients to leverage the power of dbt, the...

Read more

Databricks: The Power of Delta Lake and Lakehouse Architecture

Big Industries recently entered into a partnership with Databricks, the leading cloud-based Data...

Read more

A Warm Welcome to Jutter Peeters and Ali El Khattabi

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

A Warm Welcome to Andreia Negreira

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

Life at Big Industries: Interview with Ruben

Interview with Ruben on how it is working for Big Industries? How important are the values Share...

Read more

Happy New Year from Big Industries

Dear Employees and Customers,As the clock strikes midnight, we say goodbye to an incredible year...

Read more

Workshop Operationalizing the Machine Learning Pipeline

Data Scientists andML Practitionersneed more than a Jupyter notebook to build, test, and deploy...

Read more

Apache Iceberg: A Table Format for Large Scale Data

A comparison with Apache Kudu and Delta Lake

Apache Iceberg is an open source table format for...

Read more

A warm welcome to Muthiah Karuppiah

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

Workshop Event detection with AWS Managed Services for Apache Flink

In this workshop, you are the acting technology manager for a Las Vegas casino.

Read more

Kudos to Boris

If you grow as an employee, the company grows as well. That’s why we decided to setup the Big...

Read more

Harnessing the Power of AI with AWS SageMaker

In today's rapidly evolving technological landscape, Artificial Intelligence (AI) has emerged as a...

Read more

Apache Flink explained

Apache Flink is an open-source distributed processing engine for large-scale data streaming, batch...

Read more

Big Industries joins AWS Scale

Big Industries has joined Scale, an initiative to streamline the partnership with AWS on Cronos...

Read more

DevOps, DataOps and MLOps explained

What is the difference between DevOps and DataOps?

Read more

HowTo? Series: JOLT - Part 1

Data comes in different shapes and sizes. Sometimes, we want to shape the structure of this data...

Read more

Data Lakehouse and Data Mesh explained

Data Lakehouse and Data Mesh, what is what and where are the differences, especially the question...

Read more

HowTo? Series: Connect Git between Laptop & CDP through Azure Devops

With this How To? Series we want to #ShareOurWisdom not only internally with our Big Industries...

Read more

Apache Kafka & NiFi hands-on workshop

Introduction

If you grow as an employee, the company grows as well. That’s why we decided to setup...

Read more

Big Industries Academy: Kudos to Joanna and Soundaram

If you grow as an employee, the company grows as well. That's why we decided to setup the Big...

Read more

Life at Big Industries: Interview with Francine

How did you join/find out about Big Industries?

After finalizing my studies and my internship, I...

Read more

A warm welcome to Ruben Laureys

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

A warm welcome to Soundaram Natarajan

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

Big Industries Academy: Kudos to Francine

If you grow as an employee, the company grows as well. That’s why we decided to setup the Big...

Read more

HowTo? Series: Prepare for AWS Certified Developer exam

With this How To? Series we want to Share Our Wisdom not only internally with our Big Industries...

Read more

How To? Series: Apache Kafka Setup

With this How To? Series we want to Share Our Wisdom not only internally with our Big Industries...

Read more

Top Customer Kafka & Streaming data requests and how Big Industries can help

Data streams can be processed on a record-by-record basis or over sliding time windows, and used...

Read more

A Warm welcome to Joanna Kiesiak

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

FROM BIG DATA TO BIG INDUSTRIES

From the very beginning, BIG Industries has been driven by a singular goal: to empower companies...

Read more

A warm welcome to Kalil Zirak

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

Life at Big Industries: Interview with Shrikrishna

How did you find out about Big Industries?

During the end of my masters’ studies, I had started...

Read more

BIG Industries helps retail banks modernise in a customer-friendly way

Use case PSD2 Event Processor with Apache Kafka and Flink

BIG Industries recently helped a retail...

Read more

A warm welcome to Francine Anestis

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

A warm welcome to Jonathan Bokungu

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

Cloudera End of Support, How Big Industries can help

If you haven’t already started making plans for the HDP 3.1 or CDH 6 End of Support Life (EOSL)...

Read more

Geospatial Big Data at Big Industries PART I: Why?

Why you should read this article

You will …

  • find out what tools one might use to do geospatial...
Read more

Big Industries Academy: kudos to morad & kavitha

If you grow as an employee, the company grows as well. That’s why we decided to setup the Big...

Read more

Life at Big Industries: Interview with Lennert

How did you find out about Big Industries?

I was in my final year of my Bachelor degree and...

Read more

A warm welcome to Aditi Kumari

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

IOIntellia: Big Industries internal learning project

If you grow as an employee, the company grows as well. That’s why we decided to setup the Big...

Read more

A warm welcome to Kavitha and Omanandan

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

Life-Work balance at Big Industries

If I counted correctly, Big Industries' employees are parenting a total of 8 children (and...

Read more

A warm welcome to Morad Alouad Abdenabi

Today Morad started his internship at Big Industries for a period of 15 weeks. Morad studies...

Read more

Great reading: Data Teams by Jesse Anderson

I have been following Jesse Anderson's blog posts on Data Engineering for some time now and I was...

Read more

A warm welcome to Shrikrishna Warkhedi

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

New Internships at Big Industries

In the current data world, there are two main roles that stand out in junior profiles. A DevOps...

Read more

A warm welcome to Srivatsan Sadagopan

Congratulations on being part of Big Industries! The whole team welcomes you and we look forward...

Read more

Kudos to Berk

Kudos to Berk for passing the AWS Certified Solution Architect - Professional exam!!!

This exam...

Read more

AWS Lake Formation: Build a secure Data Lake fast

AWS Lake Formation is a service by Amazon that simplifies the building, securing and managing of...

Read more

Overcoming the 5 dysfunctions of a Team

Copyright Skool of Happiness Pte Ltd

The Big Industries values, Share your Wisdom, Feed the Family...

Read more

Are you ready for Cloudera CDP-Public Cloud?

Eleven years after its founding, Cloudera fulfilled its name in a big way with the launch of...

Read more

The Future of Big Data is Kubernetes

Data governs the era we all live in. It is these data piles that prove to be a burden to a...

Read more

Big Industries Big Meetup

The Big Industries Big Meetup is for Big Industries team mates, customers, suppliers and anyone...

Read more

Press Release: Silsombos expands thanks to Natuurpunt and Big Industries

ERPS-KWERPS – Op donderdag 19 december gaan medewerkers van Big Industries NV, een consulting...

Read more

Big Industries Academy: Kudos to Berk and Antony

If you grow as an employee, the company grows as well. That’s why we decided to setup the Big...

Read more

New Internships at Big Industries

Big Industries, a member of the Cronos Group, is Belgium’s leading Big Data & Analytics systems...

Read more

Big Industries Academy

If you grow as an employee, the company grows as well. That’s why we decided to setup the Big...
Read more

The Big Industries DNA

The Big Industries values, or in other words our DNA, are the fundamental beliefs upon which our...
Read more

Our Dream at Big Industries

“We will empower you to unleash your full potential

in a world of disruption and change”

...
Read more

Why a Data Scientist is not a Data Engineer

I found an interesting article on O'Reilly.com ,written by Jesse Anderson, which explains the...

Read more

10 proven steps to become a Data Engineer

A Data Engineer conceives, builds and maintains the data infrastructure that holds your...

Read more

Hack the future 2018

Big Industries organizes already for the fourth time the Big Data Challenge during the Hack The...

Read more

Kafka by Robin Moffatt (Confluent) and Big Industries

Join us for our next Brussels Apache Kafka® meetup on September 25th from 6:30pm, hosted...

Read more

Apache Kafka vs. Enterprise Service Bus - Friends, Enemies or Frenemies?

Typically, an Enterprise Service Bus (ESB) or other integration solutions like...

Read more

Apache Kafka: A distributed streaming Platform

Apache Kafka is a distributed streaming platform. What exactly does that mean?

A streaming...
Read more

New Partnership with Kafka vendor Confluent

Big Industries recently entered into a partnership with Confluent.

Confluent, founded by the...

Read more

Cloudera Training Tapas: Hands-on with Cloudera Impala

Are you a Data Consultant, a Data Engineer, a Data Scientist or analist and interested to use a...

Read more

Cloudera Training Tapas: Cloudera in the Cloud

Are you a Data Consultant, a Data Engineer, a Data Scientist or analist and interested to use a...

Read more

Wrapping multiple backend Hadoop web applications with HAProxy

Authorizing access to multiple Hadoop applications on different nodes of the cluster can be complex...

Read more

Cloudera Sessions London

A delegation of Big Industries recently attended the Cloudera Sessions which took place in the Old...

Read more

Hack the future 2017

Big Industries organizes for the third time the Big Data Challenge during the Hack The Future...

Read more

Does the world need cloudera?

Cloudera’s IPO in April 2017 was probably one of the most anticipated public offerings of the...

Read more

How to read compressed mnist data when using Tensorflow on Hadoop

Our team at Big Industries has been recently working on implementing TensorFlow open-source deep...

Read more

Cloudera User Group: Big Data analytics

Big Industries, as main sponsor of the Belgium Cloudera User Group, organised on Wednesday May...

Read more

Apache spark market survey

Apache Spark has quickly grown into one of the major Big Data ecosystem projects and shows no...

Read more

Infrastructure as Code: Managing Servers in the Cloud

The fundamental promise of the book can be summarized by the following (page 258)Automate...

Read more

Big Data Architectures: beyond hadoop

On March 14th Robert Gibbon gave a talk at the Digital Day organised by SAI in Brussels. During...

Read more

Why Do I need a Data Lake?

A Data Lake is an enterprise-wide system for storing and analyzing disparate sources of data in...

Read more

Emre Sevinç's Reviews > Designing Data-Intensive Applications

I consider this book a mini-encyclopedia of modern data engineering. Like a specialized...

Read more

Data Governance in hadoop environments

Belgium Cloudera User Group Meetup

Big Industries, as main sponsor of the Belgium Cloudera...

Read more

How to connect Apache Cassandra to Tableau

For a recent customer project, I supported a Cronos company so that we could install Apache...

Read more

Hack The Future

On Thursday December 8th Cronos organised their annual Hack The Future Event. This...

Read more

Cloudera User Group Meetup

Big Industries is the main sponsor and driving force behind the Belgian chapter of the Cloudera...

Read more

New Internship: Building Realtime data pipelines with streamsets

Big Industries is the foremost one-stop advanced systems integration partner for Hadoop and NoSQL...

Read more

Python eats into r as sas dominance fade

A new survey of data science tools shows that Python usage is quickly gaining steam among advance...

Read more

Creating a Data Pipeline using Flume, Kafka, Spark and Hive

The aim of this post is to help you getting started with creating a data pipeline using flume,...

Read more

Happy Birthday, Hadoop: Celebrating 10 Years

It’s hard to believe, but the first Hadoop cluster went into production at Yahoo 10 years ago...

Read more

Building Real Time Data Pipelines with Apache Kafka

Apache Kafka is a distributed publish-subscribe messaging system that is designed to be fast,...

Read more

Big Data processing with Apache Spark

Apache Spark is an open source big data processing framework built around speed, ease of use, and...

Read more

Fast Business Intelligence For All with Hadoop and Tableau

Hadoop has forever changed the way we deal with data. Its ability to support parallel processing...

Read more

Ready to set off on a BIG journey?

The top notch technologies we use set us apart from other consultancies