Apache Atlas将有关元数据更改的通知发送到名为ATLAS_ENTITIES
的Kafka主题。对元数据更改感兴趣的应用程序可以监视这些通知例如,Apache Ranger处理这些通知以根据分类授权数据访问。
Apache Atlas 1.0发送有关元数据的以下操作的通知。
ENTITY_CREATE: sent when an entity instance is created
ENTITY_UPDATE: sent when an entity instance is updated
ENTITY_DELETE: sent when an entity instance is deleted
CLASSIFICATION_ADD: sent when classifications are added to an entity instance
CLASSIFICATION_UPDATE: sent when classifications of an entity instance are updated
CLASSIFICATION_DELETE: sent when classifications are removed from an entity instance
通知包括以下数据。
AtlasEntity entity;
OperationType operationType;
List<AtlasClassification> classifications;
Apache Atlas版本0.8.x及更早版本的通知的内容格式不同,详情如下。
操作
ENTITY_CREATE: sent when an entity instance is created
ENTITY_UPDATE: sent when an entity instance is updated
ENTITY_DELETE: sent when an entity instance is deleted
TRAIT_ADD: sent when classifications are added to an entity instance
TRAIT_UPDATE: sent when classifications of an entity instance are updated
TRAIT_DELETE: sent when classifications are removed from an entity instance
通知包括以下数据。
Referenceable entity;
OperationType operationType;
List<Struct> traits;
Apache Atlas 1.0可以配置为以旧版本格式发送通知,而不是最新版本格式。这对于尚未准备好以最新版本格式处理通知的部署非常有用。要配置Apache Atlas 1.0以早期版本格式发送通知,请在atlas-application.properties
中设置以下配置:
atlas.notification.entity.version=v1
通过向Kafka主题ATLAS_HOOK
发送通知,可以向Apache Atlas通知元数据和血缘的修改。 Apache Hive/Apache HBase/Apache Storm/Apache Sqoop的Atlas hook使用此机制向Apache Atlas通知感兴趣的事件。
ENTITY_CREATE : create an entity. For more details, refer to Java class HookNotificationV1.EntityCreateRequest
ENTITY_FULL_UPDATE : update an entity. For more details, refer to Java class HookNotificationV1.EntityUpdateRequest
ENTITY_PARTIAL_UPDATE : update specific attributes of an entity. For more details, refer to HookNotificationV1.EntityPartialUpdateRequest
ENTITY_DELETE : delete an entity. For more details, refer to Java class HookNotificationV1.EntityDeleteRequest
ENTITY_CREATE_V2 : create an entity. For more details, refer to Java class HookNotification.EntityCreateRequestV2
ENTITY_FULL_UPDATE_V2 : update an entity. For more details, refer to Java class HookNotification.EntityUpdateRequestV2
ENTITY_PARTIAL_UPDATE_V2 : update specific attributes of an entity. For more details, refer to HookNotification.EntityPartialUpdateRequestV2
ENTITY_DELETE_V2 : delete one or more entities. For more details, refer to Java class HookNotification.EntityDeleteRequestV2