Skip to main content
Version: 2.0

Elasticsearch Nodes

Elasticsearch is a distributed search and analytics engine built for scalability, full-text search, and real-time data analysis. MaestroHub provides four dedicated nodes for searching, indexing, retrieving, and deleting documents within your pipelines.

Configuration Quick Reference

FieldWhat you chooseDetails
ParametersConnection, Function, Function Parameters, Timeout OverrideSelect the connection profile, function, configure function parameters with expression support, and optionally override timeout.
SettingsDescription, Timeout (seconds), Retry on Timeout, Retry on Fail, On ErrorNode description, maximum execution time, retry behavior on timeout or failure, and error handling strategy. All execution settings default to pipeline-level values.
Elasticsearch Search node configuration

Elasticsearch Search Node

Elasticsearch Search Node

Execute full-text searches using Elasticsearch Query DSL with pagination support.

Supported Function Types:

Function NamePurposeCommon Use Cases
SearchQuery documents using Elasticsearch Query DSL with optional size and from parameters for paginationLog analysis, dashboard data retrieval, filtered lookups, aggregation queries

Output Schema:

{
"hits": {
"total": { "value": 150, "relation": "eq" },
"hits": [
{
"_index": "logs-2024",
"_id": "abc123",
"_score": 1.5,
"_source": { /* document fields */ }
}
]
}
}

Elasticsearch Index node configuration

Elasticsearch Index Node

Elasticsearch Index Node

Create or update documents in an Elasticsearch index with optional document ID specification.

Supported Function Types:

Function NamePurposeCommon Use Cases
IndexInsert or update a document with JSON body and optional document IDSensor data ingestion, audit logging, event archival, data synchronization

Output Schema:

{
"_index": "sensors-2024",
"_id": "sensor-001",
"result": "created",
"_version": 1
}

The result field indicates whether the document was created (new) or updated (existing ID).


Elasticsearch Get node configuration

Elasticsearch Get Node

Elasticsearch Get Node

Retrieve a single document by its unique identifier for fast, direct lookups.

Supported Function Types:

Function NamePurposeCommon Use Cases
GetRetrieve a document by index and document IDConfiguration lookups, device registry queries, cache hits, existence checks

Output Schema:

{
"_index": "device-registry",
"_id": "device-001",
"found": true,
"_version": 3,
"_source": {
"name": "Temperature Sensor",
"location": "Building A",
"thresholds": { "min": 15, "max": 30 }
}
}

When the document doesn't exist, found is false and _source is not present.


Elasticsearch Delete node configuration

Elasticsearch Delete Node

Elasticsearch Delete Node

Remove a document from an Elasticsearch index by its unique identifier.

Supported Function Types:

Function NamePurposeCommon Use Cases
DeleteRemove a document by index and document IDExpired record cleanup, processed queue removal, data lifecycle management

Output Schema:

{
"_index": "queue-items",
"_id": "item-789",
"result": "deleted"
}

The result field is deleted if the document existed and was removed, or not_found if the document didn't exist.