error-log-logger

Description

The error-log-logger Plugin is used to push APISIX's error logs (error.log) to TCP, Apache SkyWalking, or ClickHouse servers. You can also set the error log level to send the logs to server.

It might take some time to receive the log data. It will be automatically sent after the timer function in the batch processor expires.

Attributes

Name	Type	Required	Default	Valid values	Description
tcp.host	string	True			IP address or the hostname of the TCP server.
tcp.port	integer	True		[0,...]	Target upstream port.
tcp.tls	boolean	False	false		When set to true performs SSL verification.
tcp.tls_server_name	string	False			Server name for the new TLS extension SNI.
skywalking.endpoint_addr	string	False	http://127.0.0.1:12900/v3/logs		Apache SkyWalking HTTP endpoint.
skywalking.service_name	string	False	APISIX		Service name for the SkyWalking reporter.
skywalking.service_instance_name	String	False	APISIX Instance Name		Service instance name for the SkyWalking reporter. Set it to $hostname to directly get the local hostname.
clickhouse.endpoint_addr	String	False	http://127.0.0.1:8213		ClickHouse endpoint.
clickhouse.user	String	False	default		ClickHouse username.
clickhouse.password	String	False			ClickHouse password.
clickhouse.database	String	False			Name of the database to store the logs.
clickhouse.logtable	String	False			Table name to store the logs.
host	string	False			Deprecated. Use tcp.host attribute instead. IP address or the hostname of the TCP server.
port	integer	False		[0,...]	Deprecated. Use tcp.port instead. Target Upstream port.
tls	boolean	False	false		Deprecated. Use tcp.tls instead. When set to true performs SSL verification.
tls_server_name	string	False			Deprecated. Use tcp.tls_server_name instead. Server name for the new TLS extension SNI.
timeout	integer	False	3	[1,...]	Timeout (in seconds) for the upstream to connect and send data.
keepalive	integer	False	30	[1,...]	Time in seconds to keep the connection alive after sending data.
level	string	False	WARN	["STDERR", "EMERG", "ALERT", "CRIT", "ERR", "ERROR", "WARN", "NOTICE", "INFO", "DEBUG"]	Log level to filter the error logs. ERR is same as ERROR.

This Plugin supports using batch processors to aggregate and process entries (logs/data) in a batch. This avoids the need for frequently submitting the data. The batch processor submits data every 5 seconds or when the data in the queue reaches 1000. See Batch Processor for more information or setting your custom configuration.

Enabling the Plugin

To enable the Plugin, you can add it in your configuration file (conf/config.yaml):

conf/config.yaml

plugins:
  - request-id
  - hmac-auth
  - api-breaker
  - error-log-logger

Once you have enabled the Plugin, you can configure it through the Plugin metadata.

Configuring TCP server address

You can set the TCP server address by configuring the Plugin metadata as shown below:

curl http://127.0.0.1:9080/apisix/admin/plugin_metadata/error-log-logger -H 'X-API-KEY: edd1c9f034335f136f87ad84b625c8f1' -X PUT -d '
{
  "tcp": {
    "host": "127.0.0.1",
    "port": 1999
  },
  "inactive_timeout": 1
}'

Configuring SkyWalking OAP server address

You can configure the SkyWalking OAP server address as shown below:

curl http://127.0.0.1:9080/apisix/admin/plugin_metadata/error-log-logger -H 'X-API-KEY: edd1c9f034335f136f87ad84b625c8f1' -X PUT -d '
{
  "skywalking": {
    "endpoint_addr":"http://127.0.0.1:12800/v3/logs"
  },
  "inactive_timeout": 1
}'

Configuring ClickHouse server details

The Plugin sends the error log as a string to the data field of a table in your ClickHouse server.

You can configure it as shown below:

curl http://127.0.0.1:9080/apisix/admin/plugin_metadata/error-log-logger -H 'X-API-KEY: edd1c9f034335f136f87ad84b625c8f1' -X PUT -d '
{
  "clickhouse": {
      "user": "default",
      "password": "a",
      "database": "error_log",
      "logtable": "t",
      "endpoint_addr": "http://127.0.0.1:8123"
  }
}'

Disable Plugin

To disable the Plugin, you can remove it from your configuration file (conf/config.yaml):

conf/config.yaml

plugins:
  - request-id
  - hmac-auth
  - api-breaker
  # - error-log-logger