Release HyperDX#2310
Merged
Merged
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
14d6127 to
ad88f40
Compare
ad88f40 to
1477141
Compare
1477141 to
efd4cd7
Compare
efd4cd7 to
3482782
Compare
3482782 to
a9c2676
Compare
a9c2676 to
7167ac6
Compare
7167ac6 to
d6c7094
Compare
d6c7094 to
7db11bc
Compare
7db11bc to
4b68fd7
Compare
4b68fd7 to
7c686ab
Compare
7c686ab to
4a66379
Compare
4a66379 to
8b3c16e
Compare
8b3c16e to
4b98ea6
Compare
4b98ea6 to
8d707ee
Compare
55e6431 to
af37bf2
Compare
af37bf2 to
e39ccfc
Compare
e39ccfc to
71578bb
Compare
71578bb to
1b44fac
Compare
1b44fac to
1ed76a0
Compare
1ed76a0 to
ef2b64e
Compare
ef2b64e to
6ecbdc7
Compare
2c4c9bd to
cf8430e
Compare
cf8430e to
e043e45
Compare
e043e45 to
b27719f
Compare
b27719f to
7fbc80f
Compare
wrn14897
approved these changes
May 29, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR was opened by the Changesets release GitHub action. When you're ready to do a release, you can merge this and the packages will be published to npm automatically. If you're not ready to do a release yet, that's fine, whenever you add more changesets to main, this PR will be updated.
Releases
@hyperdx/cli@0.5.0
Minor Changes
Patch Changes
b20275c: fix(cli): exit with non-zero code when
upload-sourcemapsfailsThe
upload-sourcemapscommand now exits with code 1 when uploads fail(missing source maps, pre-signed URL request failure, authentication failure,
or any per-file upload failure after retries). Previously these failures were
logged to stderr but the process exited cleanly with code 0, causing CI
pipelines to treat failed uploads as successes.
19cd7c9: fix: only use pk and row uniqueness to look up a row
8810ff0: feat: Add option for force-enabling/disabling text index support
@hyperdx/api@2.28.0
Minor Changes
3123db5: feat: experimental promql support
cb6a74c: fix(otel-collector): allow
CUSTOM_OTELCOL_CONFIG_FILEto override thedefault
memory_limiter,batch(and other pipeline processors)Pipeline
processors:lists used to be defined in the OpAMP remote configsent by the API (
packages/api/src/opamp/controllers/opampController.ts).That meant the remote config overwrote any pipeline
processors:list auser supplied via
CUSTOM_OTELCOL_CONFIG_FILE, making it impossible tosubstitute the default
memory_limiterwith one configured forlimit_percentage/spike_limit_percentagemode (ClickStack OTel collector hard-codes memory_limiter and custom config cannot override it #2145).The pipeline
processors:lists now live in the bootstrap config(
docker/otel-collector/config.yamlfor supervisor mode, anddocker/otel-collector/config.standalone.yamlfor standalone mode). TheOpAMP remote config no longer sets
processors:on these pipelines, so thebootstrap+custom merge wins. Receivers and exporters are still configured
dynamically by the OpAMP controller.
To override
memory_limiter, define a new processor with a different namein
CUSTOM_OTELCOL_CONFIG_FILEand swap the pipelineprocessors:lists:The default
memory_limiterblock defined in the base config is left inthe merged config but is no longer referenced by any pipeline; the
collector only instantiates
memory_limiter/customat runtime.The same swap pattern works for the
batchprocessor (and any other baseprocessor). For example, to lower the export timeout on a specific
pipeline:
Lighter-weight env-var tuning is also available for the default
batchprocessor without writing a custom config file:
HYPERDX_OTEL_BATCH_SEND_BATCH_SIZE,HYPERDX_OTEL_BATCH_SEND_BATCH_MAX_SIZE, andHYPERDX_OTEL_BATCH_TIMEOUT.See the README for details.
Patch Changes
d134212: feat(mcp): add hyperdx_describe_source tool and slim list_sources to catalog
Add
hyperdx_describe_source— returns full column schema, map attributekeys, and sampled low-cardinality values (SeverityText, StatusCode,
ServiceName, etc.) for a single source. Uses existing rollup tables for
performant value sampling.
Slim
hyperdx_list_sourcesto a lightweight MongoDB-only catalog (noClickHouse queries). Source tools moved to a dedicated
tools/sources/module.
All query tool descriptions and prompts updated to reference the two-step
list_sources → describe_sourcediscovery workflow.a945fa0: feat(mcp): add hyperdx_event_deltas tool
Add
hyperdx_event_deltasMCP tool that compares two row groups (targetvs baseline) and ranks properties by how much their value distributions
differ. Same algorithm as the in-app Event Deltas view.
Extract shared event-deltas algorithm from the UI into
@hyperdx/common-utils/src/core/eventDeltas.tsso it can be used byboth the frontend and the MCP server.
e1c4381: fix: bare-text Lucene search now falls back from Implicit Column Expression to
Body Expression on log sources
Previously, a log source configured with
bodyExpressionset butimplicitColumnExpressionunset threwCan not search bare text without an implicit column set.on every bare-token search, even though the row panelrendered correctly using the body column.
Search now reuses the same one-way fallback that
getEventBodyalreadyimplements: when no Implicit Column Expression is set, bare-text search runs
against the configured Body Expression. Trace sources are unchanged
(
spanNameExpressionis not a body equivalent for trace search).c3a8aa5: feat(mcp): rewrite dashboard authoring prompts and expose
filtersonhyperdx_save_dashboardThe
create_dashboardprompt now leads with a design checklist (alias every select item including number tiles, schema gap ongroupByso tables don't renderarrayElement(SpanAttributes, '...')as the column header, RED columns with aliases, per-seriesnumberFormatfor durations,groupByColumnsOnLeftfor inventory tables, dashboard-level filters instead of per-tilewhereliterals, one-metric-per-tile for metric sources, required containers at five or more tiles, post-save validation of every tile, no title-recap markdown). The wall-of-JSON canonical example is gone; thedashboard_examplespatterns carry the concrete shapes.The
dashboard_examplesset is replaced with four verified patterns (service_inventory,service_detail,log_analytics,backend_dependencies) plus the existinginfrastructure_sql. Each non-SQL example leads with a "When to use" header and a "Why this shape" note so the model picks by intent, not by surface keyword match. Examples were built and rendered on a live dev stack before landing.The
query_guideprompt gains aDASHBOARD FILTERSsection that documents thefilters: [{ type, name, expression, sourceId, where?, whereLanguage? }]shape, aNUMBER FORMATsection that explains the per-series vs. chart-level distinction, and aPER-TILE TYPE CONSTRAINTSnote that metric tiles take exactly one select item per tile.hyperdx_save_dashboardnow acceptsfilterson its input schema, reusingexternalDashboardFilterSchemaWithIdso the MCP and REST surfaces stay in lockstep and the existingconvertExternalFiltersToInternalhelper handles the conversion without translation. Filters round-trip through create, get, and update.Voice pass: every prompt string is now em-dash-free.
a4b9fa8: feat(mcp): improve MCP tool quality — error hints, shared helpers, better messages
Extract duplicated ClickHouse error handling into a shared helper with
pattern-matched error hints (DateTime64 casting, AS alias quoting, response
size limits) so agents get actionable guidance on common failures. Add
reusable mergeWhereIntoSelectItems() helper for consistent top-level where
injection. Improve source/connection-not-found messages to suggest calling
hyperdx_list_sources.
07911fd: feat(mcp): add trace waterfall and breakdown tools
Add
hyperdx_trace_waterfall— fetch all spans in a single trace as aparent/child waterfall tree with optional correlated logs. Supports
auto-pick by slowest, first error, or most recent trace.
Add
hyperdx_trace_top_time_consuming_operations— aggregate breakdownof child operations consuming the most cumulative time across traces
matching a parent-span filter. Same algorithm as the in-app "Top Most
Time Consuming Operations" chart.
04a5a92: feat: Add source scoping to dashboard filters
8810ff0: feat: Add option for force-enabling/disabling text index support
a8eb27d: feat: filters reflect all values, not search aware; filters use metadata MVs if available
Updated dependencies [3123db5]
Updated dependencies [dcab1cb]
Updated dependencies [a945fa0]
Updated dependencies [1df7583]
Updated dependencies [6a5ac3e]
Updated dependencies [e1c4381]
Updated dependencies [b30dfe0]
Updated dependencies [dcb8582]
Updated dependencies [b5148c8]
Updated dependencies [04a5a92]
Updated dependencies [8810ff0]
Updated dependencies [a8eb27d]
@hyperdx/app@2.28.0
Minor Changes
3123db5: feat: experimental promql support
1df7583: feat: emit Lucene conditions from sidebar/dashboard filters to enable KV items direct_read optimization on Map columns
Legacy
type: 'sql'filters in URLs are automatically migrated to Luceneon page load. The persisted
DashboardFilter.expressionin MongoDB is unchanged.cb6a74c: fix(otel-collector): allow
CUSTOM_OTELCOL_CONFIG_FILEto override thedefault
memory_limiter,batch(and other pipeline processors)Pipeline
processors:lists used to be defined in the OpAMP remote configsent by the API (
packages/api/src/opamp/controllers/opampController.ts).That meant the remote config overwrote any pipeline
processors:list auser supplied via
CUSTOM_OTELCOL_CONFIG_FILE, making it impossible tosubstitute the default
memory_limiterwith one configured forlimit_percentage/spike_limit_percentagemode (ClickStack OTel collector hard-codes memory_limiter and custom config cannot override it #2145).The pipeline
processors:lists now live in the bootstrap config(
docker/otel-collector/config.yamlfor supervisor mode, anddocker/otel-collector/config.standalone.yamlfor standalone mode). TheOpAMP remote config no longer sets
processors:on these pipelines, so thebootstrap+custom merge wins. Receivers and exporters are still configured
dynamically by the OpAMP controller.
To override
memory_limiter, define a new processor with a different namein
CUSTOM_OTELCOL_CONFIG_FILEand swap the pipelineprocessors:lists:The default
memory_limiterblock defined in the base config is left inthe merged config but is no longer referenced by any pipeline; the
collector only instantiates
memory_limiter/customat runtime.The same swap pattern works for the
batchprocessor (and any other baseprocessor). For example, to lower the export timeout on a specific
pipeline:
Lighter-weight env-var tuning is also available for the default
batchprocessor without writing a custom config file:
HYPERDX_OTEL_BATCH_SEND_BATCH_SIZE,HYPERDX_OTEL_BATCH_SEND_BATCH_MAX_SIZE, andHYPERDX_OTEL_BATCH_TIMEOUT.See the README for details.
b8f51ed: feat: upgrade to clickhouse-server 26.5
Patch Changes
55926e5: fix: "Add to Filters" on a JSON-typed ClickHouse column no longer produces an
unparseable Lucene query
Previously, clicking "Add to Filters" on a field under a JSON column wrapped
the field path with
toString(...)before handing it off as a Lucene filterkey. Lucene's grammar forbids parentheses inside field names, so the resulting
condition like
toString(JSONColumn.\foo`):"…"failed to parse withExpected … but ":" found.`The handler now passes the clean dot-notation path (e.g.
JSONColumn.foo)to the filter setter.
1648c22: feat(dashboard): add Table of Contents right rail with bulk collapse/expand
Adds a toggleable right-rail Table of Contents to the dashboard page, plus
"Collapse all sections" and "Expand all sections" actions. All three live
under a new "View" section in the dashboard's existing menu. TOC visibility
is persisted per-user via localStorage; bulk collapse uses the same
per-viewer URL state as single-section toggling, so it's shareable via link
and does not change the dashboard's stored defaults. Clicking a TOC entry
scrolls the section into view, auto-expanding it first if collapsed.
937e043: fix: collapse duplicate map sub-key entries in the search filter sidebar (HDX-4340)
A map sub-field stored in
filterStateunder dot notation (e.g.LogAttributes.time,from a Lucene URL round-trip) and the same key returned by the facet query under
bracket notation (e.g.
LogAttributes['time']) no longer render as two separateaccordion items. The merged entry keeps the bracket form so "Load more" stays
valid, and the user's selection still resolves via a tolerant filterState lookup.
dcab1cb: feat: default the direct_read map column optimization on supported ClickHouse versions
The full-text-search logs schema (
00002_otel_logs.sql) now ships withResourceAttributeItems,ScopeAttributeItems, andLogAttributeItemsALIAS columns plus their
text(tokenizer='array')skip indexes. Thetraces schema (
00005_otel_traces.sql) similarly gainsResourceAttributeItemsandSpanAttributeItemsALIAS columns withmatching items indexes. New installs and freshly migrated tables get
the optimization automatically — no manual
ALTER TABLErequired.Note: the traces table previously used only
bloom_filterskip indexesand worked on any ClickHouse version. The added
text(tokenizer='array')items indexes raise the minimum ClickHouse version required to create
the traces table to >= 26.2. Existing tables on older clusters are
unaffected (
CREATE TABLE IF NOT EXISTSis a no-op).At query time, the app gates the
Map['key'] = 'value'→has(<MapItems>, concat('key', '=', 'value'))rewrite on the connectedClickHouse server version (
SELECT version(), cached per connection).The gate only applies to ALIAS items columns, which are computed at
query time and therefore depend on the server being able to perform a
direct_read against the underlying Map's tuple storage. The direct_read
feature was backported into multiple stable 26.x release lines, so the
gate uses a per-branch minimum:
ALIAS items columns on servers below their branch's threshold continue
to compile filters into the original Map-subscript form.
MATERIALIZED items columns are always used when available, regardless
of ClickHouse version. MATERIALIZED columns are physically stored on
disk, so
has(items, ...)reads them directly and works on anyClickHouse version that supports the text index itself. Operators who
want the optimization on servers below the backport cutoffs can
ALTER TABLEto materialize the items columns.923b544: feat: preserve compatible filters when switching sources
b94b8ef: fix: persist column widths in search results table
996a113: fix(row-panel): hide empty attribute sections and stop showing "[Empty]"
when the source's body column isn't configured
The row-expand side panel always rendered
Log/Span AttributesandResource Attributesaccordion sections, even when both were empty. Thebody header fell back to a literal
[Empty]paper in two visuallyidentical cases that meant different things: the body column was
configured but the value was empty, or the body column wasn't configured
on the source at all.
The two attribute accordions now mirror the existing
topLevelAttributespattern and only render when their content is non-empty. The body header
takes a new
bodyConfiguredprop: whenfalse(source has neither bodynor implicit column expression configured), the body paper is suppressed
entirely. When
trueand the content is empty, the placeholder reads"No body for this event." instead of
[Empty].DBRowOverviewPanelderivesbodyConfiguredfromgetEventBody(source) !== undefined, which already returnsundefinedwhen neither expression is set.
Fixes HDX-4373.
e1c4381: fix: bare-text Lucene search now falls back from Implicit Column Expression to
Body Expression on log sources
Previously, a log source configured with
bodyExpressionset butimplicitColumnExpressionunset threwCan not search bare text without an implicit column set.on every bare-token search, even though the row panelrendered correctly using the body column.
Search now reuses the same one-way fallback that
getEventBodyalreadyimplements: when no Implicit Column Expression is set, bare-text search runs
against the configured Body Expression. Trace sources are unchanged
(
spanNameExpressionis not a body equivalent for trace search).19cd7c9: fix: only use pk and row uniqueness to look up a row
a44fa21: Number tile: pick a static color from the palette in Display Settings. The color picker stores a palette token (not a hex value) so the choice reflows correctly across light, dark, and IDE themes.
b5148c8: Dashboard table tiles configured with a row-click action now show a hover hint describing where the click will go (for example,
Search HyperDX LogsorOpen dashboard "API Latency Drilldown"). The cell wrapper is now a real link, so cmd-click and middle-click open the destination in a new tab, right-click shows the browser context menu with "Open in New Tab" and "Copy Link Address", and the destination URL appears in the browser status bar on hover. Keyboard users can Tab to a cell and press Enter to navigate, with a visible focus ring.0e8a5b3: chore: use
PageHeadertitleprop on Alerts, Dashboards, and Saved Searches list pages for consistency with the shared header API.800081c: chore: migrate the ClickHouse dashboard to shared
PageLayoutwith breadcrumbs and a sticky header (connection selector, time range, refresh) instead of a duplicate page title.41d6760: chore: migrate the Kubernetes dashboard to shared
PageLayoutwith breadcrumbs and a sticky header (log + metric sources, time range, refresh) instead of a duplicate page title.4d248bf: chore: migrate Service Map to shared
PageLayoutwith a sticky toolbar (source, sampling, time range) and no duplicate page title.633eda6: refactor: Use new VirtualMultiSelect for dashboard filter inputs
8938b05: fix: let "Load more" surface unselected values in exact filter mode
04a5a92: feat: Add source scoping to dashboard filters
b24cb88: fix(app): copy correct session URL on first Share Session click
The Share Session button captured
window.location.hrefat render time, which ran beforenuqsflushedsid/sfrom/stointo the URL. The button now reads the URL at click time via the sharedcopyTextToClipboardutil, so the first copy always contains the session params (no reload needed).8810ff0: feat: Add option for force-enabling/disabling text index support
a8eb27d: feat: filters reflect all values, not search aware; filters use metadata MVs if available
Updated dependencies [3123db5]
Updated dependencies [d134212]
Updated dependencies [dcab1cb]
Updated dependencies [a945fa0]
Updated dependencies [1df7583]
Updated dependencies [cb6a74c]
Updated dependencies [6a5ac3e]
Updated dependencies [e1c4381]
Updated dependencies [b30dfe0]
Updated dependencies [dcb8582]
Updated dependencies [c3a8aa5]
Updated dependencies [a4b9fa8]
Updated dependencies [07911fd]
Updated dependencies [b5148c8]
Updated dependencies [04a5a92]
Updated dependencies [8810ff0]
Updated dependencies [a8eb27d]
@hyperdx/common-utils@0.20.0
Minor Changes
3123db5: feat: experimental promql support
dcab1cb: feat: default the direct_read map column optimization on supported ClickHouse versions
The full-text-search logs schema (
00002_otel_logs.sql) now ships withResourceAttributeItems,ScopeAttributeItems, andLogAttributeItemsALIAS columns plus their
text(tokenizer='array')skip indexes. Thetraces schema (
00005_otel_traces.sql) similarly gainsResourceAttributeItemsandSpanAttributeItemsALIAS columns withmatching items indexes. New installs and freshly migrated tables get
the optimization automatically — no manual
ALTER TABLErequired.Note: the traces table previously used only
bloom_filterskip indexesand worked on any ClickHouse version. The added
text(tokenizer='array')items indexes raise the minimum ClickHouse version required to create
the traces table to >= 26.2. Existing tables on older clusters are
unaffected (
CREATE TABLE IF NOT EXISTSis a no-op).At query time, the app gates the
Map['key'] = 'value'→has(<MapItems>, concat('key', '=', 'value'))rewrite on the connectedClickHouse server version (
SELECT version(), cached per connection).The gate only applies to ALIAS items columns, which are computed at
query time and therefore depend on the server being able to perform a
direct_read against the underlying Map's tuple storage. The direct_read
feature was backported into multiple stable 26.x release lines, so the
gate uses a per-branch minimum:
ALIAS items columns on servers below their branch's threshold continue
to compile filters into the original Map-subscript form.
MATERIALIZED items columns are always used when available, regardless
of ClickHouse version. MATERIALIZED columns are physically stored on
disk, so
has(items, ...)reads them directly and works on anyClickHouse version that supports the text index itself. Operators who
want the optimization on servers below the backport cutoffs can
ALTER TABLEto materialize the items columns.1df7583: feat: emit Lucene conditions from sidebar/dashboard filters to enable KV items direct_read optimization on Map columns
Legacy
type: 'sql'filters in URLs are automatically migrated to Luceneon page load. The persisted
DashboardFilter.expressionin MongoDB is unchanged.Patch Changes
a945fa0: feat(mcp): add hyperdx_event_deltas tool
Add
hyperdx_event_deltasMCP tool that compares two row groups (targetvs baseline) and ranks properties by how much their value distributions
differ. Same algorithm as the in-app Event Deltas view.
Extract shared event-deltas algorithm from the UI into
@hyperdx/common-utils/src/core/eventDeltas.tsso it can be used byboth the frontend and the MCP server.
6a5ac3e: fix(charts): histogram bucket picks the highest-precision DateTime column when
Timestamp Column lists multiple columns
When a source's
Timestamp Columnlisted multiple columns (e.g."EventDate, EventTime"for partition-pruning), the histogram bucket wasbuilt from only the first token. If that token was a
Datecolumn, everyrow in a day collapsed into a single bar at midnight UTC of that day.
The bucket resolver now walks the comma-split list, queries each column's
type via metadata, and returns the highest-precision DateTime / DateTime64
token. Date columns are skipped. If no DateTime-typed token is found, the
original first-token behavior is preserved with a
console.warn.The WHERE clause continues to use the multi-column form, so partition
pruning via the
Datecolumn keeps working. The same resolved column isalso used for the
argMin/argMax/min/maxtime math in deltaexpressions.
Fixes HDX-4371.
e1c4381: fix: bare-text Lucene search now falls back from Implicit Column Expression to
Body Expression on log sources
Previously, a log source configured with
bodyExpressionset butimplicitColumnExpressionunset threwCan not search bare text without an implicit column set.on every bare-token search, even though the row panelrendered correctly using the body column.
Search now reuses the same one-way fallback that
getEventBodyalreadyimplements: when no Implicit Column Expression is set, bare-text search runs
against the configured Body Expression. Trace sources are unchanged
(
spanNameExpressionis not a body equivalent for trace search).b30dfe0: fix: support text index on lower(Body) with no preprocessor
dcb8582: fix: escape colons in Lucene field names so filters on Map sub-keys containing
:(e.g.LogAttributes['foo:bar']) parse correctlyfiltersToQuerynow backslash-escapes:and\in the emitted Lucene fieldname, and
parseLuceneFilter+ the SQL serializer decode those placeholderswhen consuming the AST so the original key is restored end-to-end.
b5148c8: Dashboard table tiles configured with a row-click action now show a hover hint describing where the click will go (for example,
Search HyperDX LogsorOpen dashboard "API Latency Drilldown"). The cell wrapper is now a real link, so cmd-click and middle-click open the destination in a new tab, right-click shows the browser context menu with "Open in New Tab" and "Copy Link Address", and the destination URL appears in the browser status bar on hover. Keyboard users can Tab to a cell and press Enter to navigate, with a visible focus ring.04a5a92: feat: Add source scoping to dashboard filters
8810ff0: feat: Add option for force-enabling/disabling text index support
a8eb27d: feat: filters reflect all values, not search aware; filters use metadata MVs if available
@hyperdx/otel-collector@2.28.0
Minor Changes
3123db5: feat: experimental promql support
cb6a74c: fix(otel-collector): allow
CUSTOM_OTELCOL_CONFIG_FILEto override thedefault
memory_limiter,batch(and other pipeline processors)Pipeline
processors:lists used to be defined in the OpAMP remote configsent by the API (
packages/api/src/opamp/controllers/opampController.ts).That meant the remote config overwrote any pipeline
processors:list auser supplied via
CUSTOM_OTELCOL_CONFIG_FILE, making it impossible tosubstitute the default
memory_limiterwith one configured forlimit_percentage/spike_limit_percentagemode (ClickStack OTel collector hard-codes memory_limiter and custom config cannot override it #2145).The pipeline
processors:lists now live in the bootstrap config(
docker/otel-collector/config.yamlfor supervisor mode, anddocker/otel-collector/config.standalone.yamlfor standalone mode). TheOpAMP remote config no longer sets
processors:on these pipelines, so thebootstrap+custom merge wins. Receivers and exporters are still configured
dynamically by the OpAMP controller.
To override
memory_limiter, define a new processor with a different namein
CUSTOM_OTELCOL_CONFIG_FILEand swap the pipelineprocessors:lists:The default
memory_limiterblock defined in the base config is left inthe merged config but is no longer referenced by any pipeline; the
collector only instantiates
memory_limiter/customat runtime.The same swap pattern works for the
batchprocessor (and any other baseprocessor). For example, to lower the export timeout on a specific
pipeline:
Lighter-weight env-var tuning is also available for the default
batchprocessor without writing a custom config file:
HYPERDX_OTEL_BATCH_SEND_BATCH_SIZE,HYPERDX_OTEL_BATCH_SEND_BATCH_MAX_SIZE, andHYPERDX_OTEL_BATCH_TIMEOUT.See the README for details.
Patch Changes
ad3f1c9: fix(otel-collector): skip string severity inference when JSON body has a
level/severityfieldWhen the log body parsed as JSON and contained a level-like field, the
pipeline still ran its
\b(alert|crit|emerg|fatal|error|err|warn|notice|debug|dbug|trace)keyword scan over the raw body string. The leading-only
\bboundarymatched any word starting with a severity keyword, so bodies containing
words like
alertmanager,alerting,errors,warning, etc. producedthe wrong severity. A Grafana sidecar log with body
{"level":"INFO", "msg":"... mimir-alertmanager-dashboard ..."}was beingtagged
SeverityText="fatal",SeverityNumber=21becausealertmatchedinside
alertmanager, even though the JSONlevelsaidINFO.A new OTTL
log_statementsblock indocker/otel-collector/config.yamlruns between the existing JSON-parseblock and the string-inference block. It promotes a JSON-derived level
field (now in
log.attributes) tolog.severity_text, which causes thestring-inference block to be skipped via its existing
severity_number == 0 and severity_text == ""guard. The block iscase-insensitive across keys by enumerating common casings of common field
names used by mainstream logging frameworks:
level/Level/LEVEL(pino, winston, zerolog, zap, logrus, slog, Serilog, NLog),
severity/Severity/SEVERITY(Datadog, GCP Cloud Logging), andlog.level(Elastic ECS, flattened from nested JSON). Eachsetself-guards on
severity_text == ""so the first match wins (priority:level>severity>log.level). The block as a whole is gated on noproducer-set severity, so explicit producer values are always preserved.
severity_numberis mapped via case-insensitive(?i)regex overseverity_text, mirroring the existing string-inference keyword set.Unrecognized values (e.g.
"verbose") fall back toINFO, matchingblock 2's else-branch. The existing
ConvertCase(severity_text, "lower")normalization is unchanged.
Behavior preserved for: non-JSON bodies, JSON bodies without a level
field, and any log record where the producer already set
severity_textorseverity_number.Fixes HDX-4383.