Blog

The first multimodal open catalog for data and AI

Unity Catalog 0.2 Introduces Models, MLflow and Apache Spark™ Integration, and support for External Identity Providers

We're excited to announce the release of Unity Catalog v0. 2, the single source of truth for all your data and ML/AI assets. This release includes some major upgrades.

October 8, 2024

Unity Catalog 0.2 Introduces Models, MLflow and Apache Spark™ Integration, and support for External Identity Providers

Unity Catalog and OpenAI

This article explains how you can use Unity Catalog with to build faster and safer AI workflows. If you're building AI applications with OpenAI, you've probably noticed how tricky it can be to keep track of all your data, models, and functions. They're often spread across different storage locations, with different rules for access and security.

GUIDE June 17, 2025

Unity Catalog: Managed vs External Tables

This article explains the difference between managed and external tables and shows you how to work with both types of tables in Managed tables are great when you want simplicity. They allow you to manage all your data and metadata in one place. External tables are great when you want flexibility over your data storage location or when you're working with external tools or collaborators.

GUIDE May 27, 2025

Unity Catalog for AI

This article explains how you can use Unity Catalog for AI use cases. Unity Catalog integrates with popular GenAI tools like , , , , and many others to make it easy to manage data, functions, and access control across AI platforms. Unity Catalog makes sure that your AI tools are secure, well-organized, and easily accessible across all supported AI platforms.

GUIDE May 05, 2025

Unity Catalog and LangChain

The Unity Catalog AI library is built to integrate Unity Catalog with popular GenAI tools like , , , and many others to make it easy to manage data, functions, and access control across AI platforms. This way you only have to define your functions, models, and security protocols once and then you can use them in multiple different AI applications and contexts. LangChain is a framework for building AI agents and tools that can reason, plan, and take actions.

GUIDE May 1, 2025

Metadata and Data Catalogs

This article explains what metadata is and how it is handled by a data catalog to make your data storage and queries more efficient and secure. The article gives an overview of metadata management and explains why a modern data catalog like Unity Catalog is better than legacy metadata management techniques. Having data is valuable, but to actually access its value the data needs to be in a format that can be quickly analyzed, easily and securely shared, and properly audited.

GUIDE April 22, 2025

Introducing Unity Catalog AI 0.3.0 Release

As part of our continued steadfast commitment to build a robust, flexible, and developer-friendly data catalog platform, we are excited to announce the release of Unity Catalog AI 0. 3. 0.

GUIDE April 22, 2025

How to use Unity Catalog Volumes

This article explains how to use Unity Catalog volumes. Unity Catalog volumes are a great place to store all your non-tabular data. This can be structured, semi-structured, or unstructured data, such as free text, audio, video, JSON, Lance datasets, etc.

GUIDE April 07, 2025

Authentication and Authorization in Unity Catalog

This article explains authentication and authorization in Unity Catalog. You will learn the fundamental importance of these two processes to modern data governance and how to implement them in Unity Catalog. Data and ML/AI pipelines require secure data governance.

GUIDE January 29, 2025

Building an ML and AI Data Catalog with Unity Catalog and MLflow

This article explains how to build an ML and AI data catalog. You will learn the importance of model governance in machine learning (ML), MLOps, and MLOps for large language models (LLMOps) workflows, as well as how to implement a governance architecture with Unity Catalog and MLflow. Machine learning and AI pipelines involve a lot of experimentation.

GUIDE January 15, 2025

Using Unity Catalog with Apache Spark and Delta Lake

This article explains how to use Unity Catalog with Apache Spark™ and Delta Lake. You will learn how to use these popular open source technologies to store, query, transform, and govern tabular datasets at scale. Managing data at scale means balancing performance, security, and ease of use.

GUIDE November 11, 2024

Integrating Apache Spark™ with Unity Catalog Assets via Open APIs

is the industry’s first open source catalog for data and AI governance across clouds, data formats, and data platforms. It is built on the OpenAPI spec and an open source server implementation under Apache 2. 0 license.

GUIDE October 28, 2024

What Is a Data Catalog and Why Do I Need One?

A data catalog is a tool for easily and securely managing all your data and AI assets. It helps you organize your data, manage access privileges, and ensure compliance with data regulations. In this blog, you will learn how data catalogs work and how you can use them to manage your data assets.

GUIDE September 26, 2024

Unity Catalog 101

Unity Catalog is a data catalog for managing all your data and AI assets easily and securely. You can use Unity Catalog to organize your data assets, collaborate, manage data access, and ensure compliance with data regulations. This blog will introduce you to how Unity Catalog works and how you can use it to manage your data assets.

GUIDE September 12, 2024

Integrating Unity Catalog with PuppyGraph for Real-time Graph Analysis

At this year's Data + AI Summit, a groundbreaking was made: Unity Catalog is now open source. This pioneering catalog, available on , is the industry's first to offer governance for data and AI across various clouds, data formats, and platforms. In an era where rapid AI advancements are commonplace, enterprises recognize the crucial need to manage data and AI assets cohesively.

GUIDE July 30, 2024