publish date
Dec 5, 2022
duration
36
min
Difficulty
Case details
The data platform is super popular in product companies because it helps us make data decisions. From my point of view, most companies try to achieve it, but the biggest problem here is how to build a suitable data platform that can handle all business, data science, and data analytics requests. If we look at history, we will find that we used data warehouse solutions early, then data lake solutions. All technologies and architecture are changing and making our life easier and better. Thanks to these technologies, we can build a lakehouse consisting of the best things for the data warehouse and data lake. Now we can find many services that offer us Lakehouse out of the box, but how can we build it without these services? Most cloud solutions provide all the necessary services to create a lakehouse by ourselves. Let's make a lakehouse on AWS and see how it can be. The lakehouse architecture is one of the most popular architectures of data platforms at the current moment. A lot of services try to offer out-of-the-box solutions. Despite this, we can build a lakehouse on AWS and don't use specific services. This topic is fresh and should help people understand that the lakehouse solution can be created using only AWS or open-source solutions. We faced many pitfalls while building the lakehouse on AWS, but we're happy with this result. I want to share my knowledge with everyone to prevent them from having similar issues. [color=#111111][color=#111111][size=2][font=Verdana, Arial, Helvetica, sans-serif][size=2][font=Verdana, Arial, Helvetica, sans-serif][h2][/font][/size][/font][/size][/color][/color][b][color=#111111][size=2][font=Verdana, Arial, Helvetica, sans-serif][color=#111111][size=2][font=Verdana, Arial, Helvetica, sans-serif][url=https://drive.google.com/file/d/14Y9Ow45fETcQCCwEDUD8ME5Kq6UAejgR/view?usp=sharing]Slides[/url][/font][/size][/color][/font][/size][/color][/b][color=#111111][color=#111111][size=2][font=Verdana, Arial, Helvetica, sans-serif][size=2][font=Verdana, Arial, Helvetica, sans-serif][/h2][/font][/size][/font][/size][/color][/color]
Share case: