Gravitino overview
What's Gravitino?
Gravitino is a high-performance, geo-distributed, and federated metadata lake. It manages the metadata directly in different sources, types, and regions. It also provides users with unified metadata access for data and AI assets.
Downloading
You can get Gravitino from the GitHub release page, or you can build Gravitino from source code, please see How to build Gravitino.
Gravitino runs on both Linux and macOS, and requires Java 8. Gravitino trino-connector runs with
Trino, and requires Java 17. This should include JVMs on x86_64 and
ARM64. It's easy to run locally on one machine --- all you need is to have java installed on
your system PATH, or the JAVA_HOME environment variable pointing to a Java installation.
See How to install Gravitino to learn how to install Gravitino server.
Gravitino provides Docker image on Docker Hub. Please pull the image and run it. For the details of Gravitino Docker image, please see Dock image details.
Gravitino also provides a playground to experience the whole Gravitino system with other components. Please see the Gravitino playground repository and How to use the playground.
Getting started
To get started with Gravitino, please see Getting started for the details.
- Getting started locally: a quick guide to start and use Gravitino locally.
- Running on Amazon Web Services: a quick guide to start and use Gravitino on AWS.
- Running on Google Cloud Platform: a quick guide to start and use Gravitino on GCP.
Gravitino playground
To experience Gravitino with other components easily, Gravitino provides a playground to run. It integrates Apache Hadoop, Apache Hive, Trino, MySQL, PostgreSQL, and Gravitino together as a complete environment. To experience the whole features, please also see Getting started and How to use the Gravitino playground to learn how to use the playground.
- Install Gravitino playground on AWS or GCP: a quick guide to start and use Gravitino playground on AWS or GCP.
- Install Gravitino playground locally: a quick guide to start and use Gravitino playground locally.
- How to use the Gravitino playground: provides an example of how to use Gravitino and other components together.
Where to go from here
Programming guides
- Manage metadata using Gravitino: provides the complete functionalities of Gravitino metadata management. Including metalake, catalog, schema and table management.
- Gravitino Open API: provides the complete Open API definition of Gravitino.
- Gravitino Javadoc: provides the Javadoc for Gravitino API.
Server administration
Gravitino provides several ways to configure and manage the Gravitino server. Please see:
- How to customize Gravitino server configurations: provides the complete Gravitino server configurations.
- Security: provides the security configurations for Gravitino, including HTTPS and OAuth2 configurations.
- Gravitino metrics: provides the metrics configurations and detailed metrics list of Gravitino server.
Catalog details
Gravitino supports different catalogs to manage the metadata in different sources. Please see:
- Lakehouse Iceberg catalog: a complete guide to use Gravitino manage Apache Iceberg data.
- How to set up Gravitino Apache Iceberg REST catalog service: a complete guide to use Gravitino as Apache Iceberg REST catalog service.
- Apache Hive catalog: a complete guide to use Gravitino manage Apache Hive data.
- JDBC MySQL catalog: a complete guide to use Gravitino manage MySQL data.
- JDBC PostgreSQL catalog: a complete guide to use Gravitino manage PostgreSQL data.
Trino connector
Gravitino provides a Trino connector to connect to Gravitino to manage the metadata in a unified way. to use the Trino connector, please see:
- How to use Gravitino Trino connector: a complete guide to use Gravitino Trino connector.
Development guides
- How to build Gravitino: a complete guide to build Gravitino from source.
- How to test Gravitino: a complete guide to run Gravitino unit tests and integration tests.
- How to sign and verify a Gravitino releases: a guide to sign and verify a Gravitino release.
- Publish Docker images: a guide to publish Gravitino Docker images, also list the change logs of Gravitino CI Docker images and release images.