System Datasets

Amorphic application provides the user with five system datasets. These datasets are available in domain which has a postfix system. The prefix depends on the shortname and environment selected for the application.

Below image shows the datasets available in the domain

The user can run SQL codes here to see or analyze the contents of datasets. User can also keep track of the history of query executions

System Datasets

sys_dynamodb_logs

This dataset has information about the calls that were made to dynamodb tables like table name of dynamodb that is accessed, function name that was used, lambda that was triggered, time and the API(if there is one) to make the call.

These logs delivery is facilitated by SQS and based on the size of payload both input and output to dynamodb there are chances that these APIs may not be logged. This has to do with SQS message size limitation.

sys_api_gateway_logs

This dataset has information about API calls made through amorphic application. It has information ranging from API resource path used to user details like username and email addresses.

sys_cloudfront_logs

This dataset has information about the cloudfront access through amorphic application. It has information about the API calls that were made through cloudfront associated with Amorphic application.

sys_cloudtrail_logs

This dataset has information about the cloudtrail logs associated with amorphic application. It has event related information.

sys_s3_buckets_logs

This dataset consists of information about the s3 calls that were made through amorphic application. It has information about the s3 endpoint, requester, bucket owner information.

In addition to consuming information from query engine, Amorphic also provides users to keep the underlying data up to date using the Update Partitions option for a few system datasets. This option is provided under System datasets tab under the Infra management menu item.