Skip to main content

Limits

Datastrato Enterprise and Apache Gravitino apply three kinds of limit. A system limit is enforced by the server and cannot be exceeded. A recommended limit marks the point beyond which performance or memory use start to degrade. A source-defined limit belongs to the system a catalog federates, and that system's documentation is authoritative. Where Gravitino and a federated source both limit the same thing, the lower of the two applies.

Names and Metadata​

ItemLimitLimit Type
Name length (metalake, catalog, schema, table, column, fileset, model, topic)64 charactersSystem
Name length (tag, policy, role, user, group, job template)128 charactersSystem
Comment length (metalake, catalog, schema, fileset, topic, tag)256 charactersSystem
Comment length (table, view, model, policy, function, job template)16 MB on a MySQL metadata storeSystem
Serialized properties per object16 MB on a MySQL metadata storeSystem
Object name length on PostgreSQL sources63 bytesSource-defined
Object name length on MySQL sources64 charactersSource-defined
Object name length on Oracle sources128 bytes (30 bytes before 12.2)Source-defined

Catalogs and Objects​

ItemLimitLimit Type
Catalogs per server (default memory settings)50Recommended
Oracle catalogs with distinct connections per server (default memory settings)30Recommended
JDBC and Iceberg JDBC catalogs per PostgreSQL source55Recommended
Schemas per catalog1,000Recommended
Tables or filesets per schema10,000Recommended
Topics or models per schema5,000Recommended
Views per schema500Recommended
Versions per model1,000Recommended
Leaf columns in a table4,000Recommended
Job templates per metalake500Recommended

Governance and Access Control​

ItemLimitLimit Type
Tags per metalake5,000Recommended
Tags per object50Recommended
Policies per metalake1,000Recommended
Policies per object20Recommended
Users per metalake10,000Recommended
Groups per metalake500Recommended
Roles per metalake200Recommended
Roles per user20Recommended
Groups per user10Recommended
Users per group500Recommended
Securable objects per role20Recommended