Stream logs into a domain and use OpenSearch Dashboards to explore them.
Log ingestion, search, and dashboards
Amazon OpenSearch Service manages search and analytics clusters for workloads such as application log analysis. OpenSearch Dashboards visualizes the data.
How it works
- Create a domainAn OpenSearch Service domain is a managed cluster with its own settings and resources., the managed cluster that stores and searches data. Choose public access or access through a virtual private cloudA VPC is a logically isolated virtual network in which AWS resources can run. (VPC), a logically isolated virtual network.
- For CloudWatch Logs, create an OpenSearch subscription filterA subscription filter selects log events by pattern and identifies where to send matching events. on a Standard class log group. The filter selects matching events for near-real-time delivery to the domain. The console setup requires a Lambda execution role with domain access; a VPC domain also needs the AWSLambdaVPCAccessExecutionRole policy.
- Use OpenSearch Dashboards to visualize the data. An indexAn OpenSearch index is like a database table, with documents as rows and fields as columns. is like a database table, with documents as rows.
Exam cues
- If the question says search application logs and build dashboards, think OpenSearch Service and OpenSearch Dashboards, because they provide log analytics and visualization.
- If the question says stream a CloudWatch log group into OpenSearch, think an OpenSearch subscription filter, because it sends matching events to the domain.
- If the question says query archived files directly in S3 using SQL, think Athena, because it queries S3 data without an OpenSearch domain.
- If the question says deliver CloudWatch Logs to OpenSearch through Firehose, think the OpenSearch subscription filter, because Firehose does not support that CloudWatch Logs destination path.
Remember
- Subscriptions require the Standard log class.
- Public or VPC domain access cannot be changed after domain creation.
Trap: Firehose supports OpenSearch destinations, but not delivery of CloudWatch Logs to those destinations. CloudWatch combines multiple log events in a single Firehose record.
A subscription filter sends matching log events to the domain.
OpenSearch Dashboards visualizes data in the domain.
Da documentação da AWS (13)
- OpenSearch Service manages OpenSearch clusters for search and analytics, including log analytics and application monitoring.
- An OpenSearch Service domain is a cluster with specified settings, instance types, instance counts, and storage.
- OpenSearch Dashboards visualizes data in OpenSearch Service.
- An OpenSearch index is comparable to a database table, with documents as rows and fields as columns.
- A CloudWatch Logs subscription filter can send matching log events to an OpenSearch Service domain in near real time.
- CloudWatch Logs subscriptions support only Standard class log groups.
- The CloudWatch console's OpenSearch subscription setup requires a Lambda execution role with access to the domain; a VPC domain also requires the AWSLambdaVPCAccessExecutionRole policy.
- An OpenSearch Service domain can use public or VPC access, but its access type cannot be changed after creation.
- A VPC is a logically isolated virtual network in which AWS resources can run.
- Firehose does not support delivering CloudWatch Logs to an OpenSearch Service destination because CloudWatch combines multiple log events in one Firehose record.
- Athena runs interactive SQL queries directly against data stored in S3.
- OpenSearch Serverless collections scale compute automatically, suit infrequent or unpredictable workloads, and are always encrypted.
- An OpenSearch Ingestion pipeline can stream DynamoDB table changes into OpenSearch, with or without an initial full snapshot, to add search over DynamoDB data.
Flashcards
Nada para revisar aqui agora. Escolha outros tópicos ou outro filtro.
·
Todos os 5 flashcards em lista
A team needs interactive search and dashboards for CloudWatch application logs. What AWS service and ingestion path fit?
OpenSearch Service and OpenSearch Dashboards. Use a CloudWatch Logs subscription filter for a Standard class log group.
A team wants to send CloudWatch Logs through Firehose directly to an OpenSearch Service destination. Is this supported?
No. Firehose does not support that CloudWatch Logs destination path; use the OpenSearch subscription filter.
A team wants to query archived logs directly in S3 using SQL rather than operate a search cluster. Which AWS service fits?
Amazon Athena. It runs interactive SQL queries directly against data in S3.
Can an existing OpenSearch Service domain switch from public access to VPC access?
No. Choose the access type when creating the domain; it cannot be changed afterward.
A team wants to analyze CloudWatch log events in Amazon OpenSearch Service as they arrive. What can send matching events to the domain?
A CloudWatch Logs subscription filter can send matching events to the OpenSearch Service domain in near real time.