Auditing Service
ESS Auditing Service audits various activities from the ESS services, including itself.
For more information on auditing, see https://github.com/inrupt/docs-gitbook/blob/main/ess/security/auditing/README.md
By default, auditing is enabled and logs the audit events to sysout
.
ESS uses asynchronous messaging for auditing.
To ensure that audit messages are delivered, the Audit Service may send the message more than once.
For instance, multiple instances of the Audit Service may exist when applying configuration changes or when performing a rolling upgrade. During this time, duplicate messages (i.e., messages with the same unique id
value) can occur if the old Audit instance processes a message but shuts down before acknowledging the message on Kafka, and then, the new Audit instance processes the unacknowledged message.
Audit Events
A complete list of Audit Events can be found at https://github.com/inrupt/docs-gitbook/blob/main/ess/security/auditing/README.md. For auditing event examples, see https://github.com/inrupt/docs-gitbook/blob/main/ess/security/auditing/appendix-audit-events-examples.md.
Integration with External Logging Systems
The ESS Auditing Service can log to:
sysout
(default)Syslog
When logging audit messages to sysout
(the default), Auditing service uses the shared ESS logging components, which use JSON as the default formatting for log messages. As such, audit messages logged to sysout
are contained in the auditEvent
field of the log message. The audit event message itself (i.e., the auditEvent
value) is serialized as a JSON-LD documents.
Integration with Syslog
The ESS Auditing Service can integrate with Syslog. When integrating with Syslog, ESS audit events are converted to Syslog message format:
<priority>version timestamp hostname service processId messageId message
Where:
hostname
,service
,processId
andmessageId
values are taken extracted from the audit eventagent
field.message
is the full ESS audit event message in JSON.
For example (the event message has been abbreviated):
<110>1 2022-01-12T20:17:08.387Z ess-pod-storage-84648cfc95-qs865 inrupt-storage-postgres-s3 85 urn:uuid:579668c1-4e14-4fad-aea3-0000000005 { "@context": [ "https://www.w3.org/ns/activitystreams", "https://schema.inrupt.com/audit/v1.jsonld" ], "id": "urn:uuid:579668c1-4e14-4fad-aea3-0000000005", "type": ["Activity", "Create"], "name": "resource-created", "summary": "Resource has been created", ... }
By default, the Auditing service logs to sysout
. To have the service output to Syslog instead, see Manage Auditing.
See also Syslog configuration options.
For more information on Syslog, see RFC 5424.
Integration with Sentinel
The ESS Auditing Service can integrate with Microsoft Sentinel.
When integrating with Microsoft Sentinel, the ESS audit events are converted into a Sentinel-specific format and POST
’ed to the Sentinel service.
By default, the Auditing Service logs to sysout
. To have the service output to Sentinel instead, see Manage Auditing.
See also Sentinel configuration options.
Configuration
As part of the installation process , Inrupt provides base Kustomize overlays and associated files that require deployment-specific configuration inputs.
The following configuration options are available for the service and may be set as part of updating the inputs for your deployment. The Inrupt-provided base Kustomize overlays may be using updated configuration values that differ from the default values.
Auditing Service: General Configuration
QUARKUS_HTTP_PORT
Default : 8080
The HTTP port the audit service runs on.
QUARKUS_LOG_LEVEL
Default : INFO
Logging level.
Audit Service: Kafka
INRUPT_KAFKA_AUDITV1EVENTSENCRYPTED_CIPHER_PASSWORD
The strong cipher key to use when running auditing with encrypted messages over the auditv1eventsencrypted
topic.
INRUPT_KAFKA_AUDITV1EVENTSPRODUCERENCRYPTED_CIPHER_PASSWORD
The strong cipher key to use when running auditing with encrypted messages over the auditv1eventsproducerencrypted
topic.
KAFKA_BOOTSTRAP_SERVERS
Default : localhost:9092
Comma-delimited list of Kafka broker servers for use by ESS services, including this service.
Setting KAFKA_BOOTSTRAP_SERVERS
message channels (e.g., solidresource
and auditv1out
message channels). This service uses the auditv1in
and auditv1out
channels.
Auditing Service: Syslog Configuration
By default, the Auditing service logs to sysout
. To have the service output to Syslog instead:
Customize your deployment to output to Syslog. See Manage Auditing for details.
Update configuration for Syslog integration. The following configuration options are available for integration with Syslog.
INRUPT_AUDIT_SYSLOG_HOST
Default : localhost
The syslog server hostname that the audit service will connect to.
INRUPT_AUDIT_SYSLOG_PORT
Default : 514
The syslog server port that the audit service will connect to.
INRUPT_AUDIT_SYSLOG_PROTOCOL
Default : SSL_TCP
The protocol used to connect to the syslog server. Valid values are:
TCP
SSL_TCP
Auditing Service: Sentinel Configuration
By default, the Auditing service logs to sysout
. To have the service output to Microsoft Sentinel instead:
Customize your deployment to output to Sentinel. See Manage Auditing for details.
Update configuration for Sentinel integration. The following configuration options are available for integration with Microsoft Sentinel.
INRUPT_AUDIT_SENTINEL_API_VERSION
The Sentinel API version.
INRUPT_AUDIT_SENTINEL_LOG_TYPE
Default : Audit
The Sentinel Log-Type of the message.
INRUPT_AUDIT_SENTINEL_SHARED_KEY
Shared key used to access the Sentinel API.
INRUPT_AUDIT_SENTINEL_WORKSPACE_ID
Workspace ID used to access the Sentinel API.
QUARKUS_REST_CLIENT_SENTINEL_API_URL
The Sentinel base URL that the audit service will connect to.
Log Redaction
INRUPT_LOGGING_REDACTION_NAME_ACTION
Default : REPLACE
Type of the redaction to perform. Supported values are:
REPLACE
Default. Replaces the matching text with a specified replacement.
PLAIN
Leaves the matching field unprocessed. Only available if the redaction target is a field (i.e., INRUPT_LOGGING_REDACTION_{NAME}_FIELD
).
DROP
Suppresses the matching field. Only available if the redaction target is a field (i.e.,INRUPT_LOGGING_REDACTION_{NAME}_FIELD
).
PRIORITIZE
Changes the log level of the matching message.
SHA256
Replaces the matching text with its hash.
If the action is
REPLACE
( default ), see alsoINRUPT_LOGGING_REDACTION_{NAME}_REPLACEMENT
.If the action is to
PRIORITIZE
, see alsoINRUPT_LOGGING_REDACTION_{NAME}_LEVEL
.
For more information on log redaction, see Logging Redaction
INRUPT_LOGGING_REDACTION_NAME_ENABLED
Default : true
A boolean that determines whether the redaction configurations with the specified INRUPT_LOGGING_REDACTION_{NAME}_
prefix is enabled.
For more information on log redaction, see Logging Redaction .
INRUPT_LOGGING_REDACTION_NAME_EXCEPTION
Fully qualified name of the exception class to match in the log messages (includes inner exception). Configure to target an exception message class.
For more information on log redaction, see Logging Redaction
INRUPT_LOGGING_REDACTION_NAME_FIELD
Exact name of the field to match in the log messages. Configure to target a specific log message field for redaction.
For more information on log redaction, see Logging Redaction
INRUPT_LOGGING_REDACTION_NAME_LEVEL
A new log level to use for the log message if the INRUPT\_LOGGING\_REDACTION\_{NAME}\_ACTION
is PRIORITIZE
.
INRUPT_LOGGING_REDACTION_NAME_PATTERN
A regex (see Java regex pattern) to match in the log messages. Configure to target log message text that matches a specified pattern.
For more information on log redaction, see Logging Redaction
INRUPT_LOGGING_REDACTION_NAME_REPLACEMENT
Replacement text to use if the INRUPT\_LOGGING\_REDACTION\_{NAME}\_ACTION
is REPLACE
.
If unspecified, defaults to [REDACTED]
.
For more information on log redaction, see Logging Redaction
Application-Defined Metadata Propagation
INRUPT_AUDIT_PRODUCER_REQUEST_METADATA_ALLOW
A comma-separated list of application-defined properties that can be included in the associated audit events (unless specified in the corresponding INRUPT\_AUDIT\_PRODUCER\_REQUEST\_METADATA\_DENY
).
This configuration is case-sensitive to the propagated properties in the baggage.
See:
Manage Application-Defined Metadata Propagation to configure.
Application-Defined Metadata for more information.
INRUPT_AUDIT_PRODUCER_REQUEST_METADATA_DENY
A comma-separated list of application-defined properties to exclude from the associated audit messages. This setting takes precedence over INRUPT_AUDIT_PRODUCER_REQUEST_METADATA_ALLOW
.
This configuration is case-sensitive to the propagated properties in the baggage.
See:
Manage Application-Defined Metadata Propagation to configure.
Application-Defined Metadata for more information.
INRUPT_LOGGING_REQUEST_METADATA_ALLOW
A comma-separated list of application-defined properties that can be included in the associated log messages (unless specified in the corresponding INRUPT_LOGGING_REQUEST_METADATA_DENY
).
This configuration is case-sensitive to the propagated properties in the baggage.
See:
Manage Application-Defined Metadata Propagation to configure.
Application-Defined Metadata for more information.
INRUPT_LOGGING_REQUEST_METADATA_DENY
A comma-separated list of application-defined properties to exclude from the associated log messages. This setting takes precedence over INRUPT_LOGGING_REQUEST_METADATA_ALLOW.
This configuration is case-sensitive to the propagated properties in the baggage.
See:
Manage Application-Defined Metadata Propagation to configure.
Application-Defined Metadata for more information.
INRUPT_REQUEST_METADATA_PROPAGATOR_HEADER_ALLOW
A comma-separated list of non-baggage request headers to add to the baggage (unless specified in the corresponding INRUPT_REQUEST_METADATA_PROPAGATOR_HEADER_DENY
); i.e., include these non-baggage request headers as application-defined properties.
The configuration is case-insensitive; i.e., the listed headers do not need to match the case of the client request headers. For example, a list that includes x-correlation-id
can match x-correlation-id
header, X-CoRrElAtIoN-Id
header, etc.
See:
Manage Application-Defined Metadata Propagation to configure.
Application-Defined Metadata for more information.
INRUPT_REQUEST_METADATA_PROPAGATOR_HEADER_DENY
A comma-separated list of non-baggage request headers to exclude from being added to the baggage; i.e., excludes these headers as application-defined properties. This setting takes precedence over INRUPT_REQUEST_METADATA_PROPAGATOR_HEADER_ALLOW
.
The configuration is case-insensitive; i.e., the listed headers do not need to match the case of the client request headers. For example, a list that includes x-correlation-id
can match (and exclude) x-correlation-id
header, X-CoRrElAtIoN-Id
header, etc.
See:
Manage Application-Defined Metadata Propagation to configure.
Application-Defined Metadata for more information.
INRUPT_REQUEST_METADATA_PROPAGATOR_HEADER_OVERRIDES
A flag that determines ESS behavior when metadata property is defined both as a header and as a baggage entry:
If
true
, ESS updates/overrides the baggage entry with the header value.If
false
(the default), ESS keeps the baggage entry.
For details, Duplicate Property Definition.
INRUPT_REQUEST_METADATA_REFLECTOR_HEADER_ALLOW
A comma-separated list of application-defined properties that can return as response headers (unless specified in the corresponding INRUPT_REQUEST_METADATA_REFLECTOR_HEADER_DENY
).
This configuration is case-sensitive to the propagated properties in the baggage.
See:
Manage Application-Defined Metadata Propagation to configure.
Application-Defined Metadata for more information.
INRUPT_REQUEST_METADATA_REFLECTOR_HEADER_DENY
A comma-separated list of application-defined properties to exclude from returning as response headers. This setting takes precedence over INRUPT_REQUEST_METADATA_REFLECTOR_HEADER_ALLOW
This configuration is case-sensitive to the propagated properties in the baggage.
See:
Manage Application-Defined Metadata Propagation to configure.
Application-Defined Metadata for more information.
Additional Information
See also Quarkus Configuration Options
Last updated