Name		Name	Last commit message	Last commit date
parent directory ..
Project: Favorita Store Sales - Time Series Forecasting		Project: Favorita Store Sales - Time Series Forecasting
Project: MultiLabel classification for Computer Vision		Project: MultiLabel classification for Computer Vision
Project: Retrieval Augmented Generation Chatbot		Project: Retrieval Augmented Generation Chatbot
Project: Streaming Transactions		Project: Streaming Transactions
README.md		README.md

README.md

Chapter 4: Getting to Know Your Data

Here is what you will learn as part of this chapter:

Improving data integrity with Delta Live Tables (DLT)
Monitoring data quality with Databricks Lakehouse Monitoring
Exploring data with Databricks Assistant
Generating data profiles with AutoML
Using embeddings for machine-readable data
Enhancing data retrieval with Databricks Vector Search
Applying our learning

Technical requirements

Here are the technical requirements needed to complete the hands-on examples in this chapter:

The Databricks Assistant is a newer feature that an administrator can enable. We will show the Assistant in this chapter.
We use the missingno library to address missing numbers in our project data.
In the section using AutoML, we reference the AutoML-generated notebook, which you can find in the GitHub repository.

Links

In the chapter

ydata-profiling

Further Reading