You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: site/docs/connectors/index.md
+44-38
Original file line number
Diff line number
Diff line change
@@ -7,19 +7,61 @@ Egeria has a growing collection of *connectors* to third party technologies. The
7
7
8
8
A connector is a client to a third party technology. It supports a standard API that Egeria calls, and it then translates these calls into requests to the third party technology. Some connectors are also able to listen for notifications from the third party technology. When a notification is received, the connector converts its content into a call to Egeria to distribute the information to the open metadata ecosystem.
9
9
10
-
Connectors enable Egeria to operate in many environments and with many types of third party technologies, just by managing the configuration of the [OMAG servers](/concepts/omag-server). The Connector Catalog list the connector implementations supplied by the Egeria community. There are three broad categories of connectors and the connector catalog is organized accordingly:
10
+
Connectors enable Egeria to operate in many environments and with many types of third party technologies, just by managing the configuration of the [OMAG servers](/concepts/omag-server). The Connector Catalog list the connector implementations supplied by the Egeria community. There are four broad categories of connectors and the connector catalog is organized accordingly:
11
+
12
+
* Connectors that support the [security of the open metadata ecosystem](#open-metadata-security-connectors).
11
13
12
14
* Connectors that support the [exchange and maintenance of metadata](#metadata-exchange-and-maintenance-connectors) with third party technology. This includes the resource connectors, survey action connectors, integration connectors and adapter repository connectors. These connectors are organized by the type of third part technology type work with.
13
15
14
16
* Connectors that support the [governance of open metadata](#open-metadata-governance-connectors). This includes the context event services and governance action services. These connectors are organized by function.
15
17
16
18
* Connectors that support the integration of [Egeria’s runtimes](#runtime-connectors) into the IT infrastructure where it is running. This includes the native repository connectors, event bus connectors, cohort registry stores, configuration stores, audit log destination connectors, open metadata archive stores, REST client connectors and the cohort member remote repository connectors. These connectors are organized by connector type.
17
19
20
+
## Open Metadata Security Connectors
21
+
22
+
The connectors that support the security of the open metadata ecosystem are:
23
+
24
+
*[Secrets Store connectors](#secrets-stores) manage the retrieval of secrets (passwords, certificates, ...) from secured locations at runtime.
25
+
*[Metadata Security connectors](#metadata-security-connectors) provides authorization support for the OMAG Server Platform and the OMAG Servers that run on it.
26
+
27
+
### Secrets Stores
28
+
29
+
[Secrets stores](/concepts/secrets-store-connector) externalize secrets such as passwords, tokens and certificates so they do not need to be stored in either the [configuration document](/concepts/configuration-document) or [open metadata repositories](/concepts/open-metadata-repository).
30
+
31
+
* The [YAML File Secret Store connector](/connectors/secrets/yaml-file-secrets-store-connector) retrieves secret values from environment variables.
32
+
* The [Environment Variables Secret Store connector](/connectors/secrets/environment-variable-secrets-store-connector) retrieves secret values from environment variables.
33
+
34
+
### Metadata Security Connectors
35
+
36
+
The Metadata Security Connectors manage authorization requests for the open metadata and governance servers.
37
+
Strictly speaking there are two types of metadata security connectors:
38
+
39
+
**Platform Metadata Security Connectors* manage authorization of OMAG Server Platform's services.
40
+
**Server Metadata Security Connectors* manage authorization requests for the OMAG Server's services.
Egeria has a single metadata security connector that implements both interfaces:
51
+
52
+
* The [Open Metadata Access Security Connector](/connectors/metadata-security/open-metadata-access-security-connector) uses information from an embedded [secrets store connector](/concepts/secrests-store-connector) so all authorization decisions can be controlled through the contents of the externalized secrets store.
53
+
54
+
??? education "Further information relating to Metadata Security Connectors"
55
+
- [Metadata Security Overview](/features/metadata-security/overview) to understand the metadata security connectors in the context of all of the security features.
56
+
- [Configuring a Platform Metadata Security Connector](/guides/admin/configuring-the-omag-server-platform/#platform-security) in the [OMAG Server Platform](/concepts/omag-server-platform)
57
+
- [Configuring a Server Metadata Security Connector](/guides/admin/servers/by-section/server-security-connection-section) in the [OMAG Server](/concepts/omag-server)
58
+
- [Writing a Platform Metadata Security Connector](/guides/developer/runtime-connectors/platform-metadata-security-connector).
59
+
- [Writing a Server Metadata Security Connector](/guides/developer/runtime-connectors/server-metadata-security-connector).
60
+
18
61
## Metadata exchange and maintenance connectors
19
62
20
63
The connectors that support the exchange and maintenance of metadata help to accelerate the rollout of your open metadata ecosystem, since they can be used to automate the extraction and distribution of metadata to the third party technologies.
21
64
22
-
*[Secrets Store connectors](#secrets-stores) manage the retrieval of secrets (passwords, certificates, ...) from secured locations at runtime.
23
65
*[File connectors](#files) work with different types of files.
24
66
*[JDBC Database connectors](#relational-databases) make use of the JDBC standards to work with different types of relational databases.
25
67
*[Apache Kafka connectors](#apache-kafka) work with the topics and/or events passing through the Apache Kafka event broker.
@@ -28,12 +70,6 @@ The connectors that support the exchange and maintenance of metadata help to acc
28
70
*[Open API Specification connectors](#open-api-specification) extract metadata about APIs through the Open API interfaces provided through the Swagger API.
29
71
*[Open Lineage Event connectors](#open-lineage-events) works with the open lineage event standard.
30
72
31
-
### Secrets Stores
32
-
33
-
[Secrets stores](/concepts/secrets-store-connector) externalize secrets such as passwords, tokens and certificates so they do not need to be stored in either the [configuration document](/concepts/configuration-document) or [open metadata repositories](/concepts/open-metadata-repository).
34
-
35
-
* The [Environment Variables Secret Store connector](/connectors/secrets/environment-variable-secrets-store-connector) retrieves secret values from environment variables.
36
-
* The [YAML File Secret Store connector](/connectors/secrets/yaml-secrets-store-connector) retrieves secret values from environment variables.
37
73
38
74
### Files
39
75
@@ -130,8 +166,6 @@ The open lineage connectors work with the [Open Lineage standard](/features/line
|[Repository and Event Mapper connectors](#repository-and-event-mapper-connectors)| Integrate metadata repositories into the open metadata ecosystem so that they can interact with one or more [open metadata repository cohorts](/services/omrs/cohort). |
133
-
|[Platform Metadata Security Connectors](#platform-metadata-security-connectors)| manage authorization requests for the OMAG Server Platform's services. |
134
-
|[Server Metadata Security Connectors](#server-metadata-security-connectors)| manage authorization requests for the OMAG Server's services. |
135
169
|[Configuration Document Store Connectors](#configuration-document-store-connectors)| manage the persistence and retrieval of [configuration documents](/concepts/configuration-document). |
136
170
|[Cohort Registry Store Connectors](#cohort-registry-store-connectors)| store the [open metadata repository cohort](/concepts/cohort-member) membership details in the [cohort registry store](/concepts/cohort-registry-store). |
137
171
|[Open Metadata Archive Store Connectors](#open-metadata-archive-store-connectors)| read and write [open metadata archives](/concepts/open-metadata-archive). |
@@ -171,34 +205,6 @@ The table below lists the repository connectors that act as an adapter for third
171
205
- [Writing repository and event mapper connectors](/guides/developer/repository-connectors/overview) for more information on writing new repository and event mapper connectors.
There is one implementation of the platform metadata security connector provided by Egeria. It is a sample that encodes information from the Coco Pharmaceutical scenarios.
??? education "Further information relating to Platform Metadata Security Connectors"
183
-
184
-
- [Configuring a Platform Metadata Security Connector](/guides/admin/configuring-the-omag-server-platform/#platform-security) in the [OMAG Server Platform](/concepts/omag-server-platform)
185
-
- [Metadata Security](/features/metadata-security/overview) to understand the platform metadata security connector in the context of all of the security features.
186
-
- [Writing a Platform Metadata Security Connector](/guides/developer/runtime-connectors/platform-metadata-security-connector).
There is one implementation of the server metadata security connector provided by Egeria. It is a sample that encodes information from the Coco Pharmaceuticals scenarios.
193
-
194
-
***[Coco Pharmaceuticals Server Metadata Security Connector :material-github:](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-samples/open-metadata-security-samples){ target=gh }**
195
-
196
-
??? education "Further information relating to Server Metadata Security Connectors"
197
-
198
-
- [Configuring a Server Metadata Security Connector](/guides/admin/configuring-the-omag-server-platform/#platform-security) in the [OMAG Server Platform](/concepts/omag-server-platform)
199
-
- [Metadata Security](/features/metadata-security/overview) to understand the server metadata security connector in the context of all of the security features.
200
-
- [Writing a Server Metadata Security Connector](/guides/developer/runtime-connectors/server-metadata-security-connector).
- Jar File Name: `yaml-secrets-store-connector.jar`
12
+
13
+
## Overview
14
+
15
+
The *YAML File Secrets Store Connector* is a [Secrets Store Connector](/concepts/secrets-store-connector) that retrieves secrets from a named YAML file. By convention, these YAML files have a file extension of `omsecrets`.
> **Figure 1:** Operation of the YAML File Secrets Store Connector
19
+
20
+
Secrets within the YAML file are organized into collections. Each collection represents a set of secrets needed by a particular type of caller. When the YAML File Secrets Store Connector starts up, it opens the YAML file using the address passed in the endpoint of its connection. It located the appropriate collection using the name specified in the `secretsCollectionName` property found in the connection's `configurationProperties`. The connector will fail if either of these two values are missing.
21
+
22
+
23
+
24
+
Inside a collection are:
25
+
26
+
* A refresh time interval (`refreshTimeInterval`) that defines how long the secrets can be cached. When the time expires, the connector retrieves the secrets from the cache.
27
+
* A map of named secrets (`secrets`) - such as details of certificates or userId and passwords. These secrets are used by other connectors, and automated services to log on to remote services.
28
+
* The details of an API to call to retrieve a token (`tokenAPI`). This includes the HTTP request type, URL and details fo the request and response body. This supplements the secrets map allowing certain secrets to be retrieved dynamically.
29
+
* A map of userIds to user account details (`users`). This is needed by a connector that is supporting a user authentication service.
30
+
* A map of named lists (`namedLists`) that is used to represent organizational units, security roles and groups needed by an authorization service.
31
+
32
+
Complete details of this structure can be found in [Egeria's Javadoc](https://odpi.github.io/egeria/org/odpi/openmetadata/adapters/connectors/secretsstore/yaml/secretsstore/package-summary.html) and an example can be found in [GitHub](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-deployment/secrets).
33
+
34
+
## Configuration
35
+
36
+
This is its connection definition to embed into a calling connector's connection object.
37
+
38
+
!!! example "Connection configuration for the environment variable secrets store connector"
- Jar File Name: `yaml-secrets-store-connector.jar`
12
12
13
13
## Overview
14
14
15
-
The *YAML File Secrets Store Connector* is a [Secrets Store Connector](/concepts/secret-store-connector) that retrieves secrets from a named YAML file. By convention, these YAML files have a file extension of `omsecrets`.
15
+
The *YAML File Secrets Store Connector* is a [Secrets Store Connector](/concepts/secrets-store-connector) that retrieves secrets from a named YAML file. By convention, these YAML files have a file extension of `omsecrets`.
> **Figure 1:** Operation of the YAML File Secrets Store Connector
19
19
20
20
Secrets within the YAML file are organized into collections. Each collection represents a set of secrets needed by a particular type of caller. When the YAML File Secrets Store Connector starts up, it opens the YAML file using the address passed in the endpoint of its connection. It located the appropriate collection using the name specified in the `secretsCollectionName` property found in the connection's `configurationProperties`. The connector will fail if either of these two values are missing.
21
21
22
-
23
-
24
22
Inside a collection are:
25
23
26
24
* A refresh time interval (`refreshTimeInterval`) that defines how long the secrets can be cached. When the time expires, the connector retrieves the secrets from the cache.
Copy file name to clipboardExpand all lines: site/docs/content-packs/apache-atlas-content-pack/overview.md
+1
Original file line number
Diff line number
Diff line change
@@ -5,5 +5,6 @@
5
5
6
6
The *ApacheAtlasContentPack* contains the connector definitions for the Apache Atlas connectors and governance services supplied in the *omag-server-platform* distribution along with the valid metadata values for the technologies they support. This content pack is designed to provide a good starting point for connecting Egeria to Apache Atlas.
7
7
8
+
This content pack is built by the [core-content-pack](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-archives/) module.
Copy file name to clipboardExpand all lines: site/docs/content-packs/apache-kafka-content-pack/overview.md
+2
Original file line number
Diff line number
Diff line change
@@ -6,4 +6,6 @@
6
6
The *ApacheKafkaContentPack* contains the connector definitions for the Apache Kafka connectors and governance services supplied in the *omag-server-platform* distribution along with the valid metadata values for the technologies they support. This content pack is designed to provide a good starting point for connecting Egeria to Apache Kafka in order ti access its metadata.
7
7
8
8
9
+
This content pack is built by the [core-content-pack](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-archives/) module.
Copy file name to clipboardExpand all lines: site/docs/content-packs/apis-content-pack/overview.md
+1
Original file line number
Diff line number
Diff line change
@@ -5,5 +5,6 @@
5
5
6
6
The *APIsContentPack* contains the connector definitions for the connector the catalogs an open API through its swagger REST API. This connector is supplied in the *omag-server-platform* distribution. This content pack is designed to provide a good starting point for connecting Egeria to applications supporting the open API specification in order to build an API catalog.
7
7
8
+
This content pack is built by the [core-content-pack](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-archives/) module.
Copy file name to clipboardExpand all lines: site/docs/content-packs/cim-content-pack/overview.md
+2
Original file line number
Diff line number
Diff line change
@@ -12,4 +12,6 @@ The *CloudInformationModel* content pack is an extraction for a glossary for the
12
12
13
13
This archive is available on GitHub as `CloudInformationModel.omarchive` at [https://github.com/odpi/egeria/blob/main/content-packs/CloudInformationModel.json](https://github.com/odpi/egeria/blob/main/content-packs/CloudInformationModel.json). It is also included in Egeria's standard `omag-server-platform` distribution built from the `egeria.git` repository.
14
14
15
+
This content pack is built by the [cloud-information-model](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-samples/cloud-information-model) module.
0 commit comments