Skip to content

Commit

Permalink
[DOCS] Adds data stream and ILM related limitation items to transforms (
Browse files Browse the repository at this point in the history
  • Loading branch information
szabosteve authored Sep 30, 2020
1 parent c9534e0 commit bfbd616
Showing 1 changed file with 26 additions and 1 deletion.
27 changes: 26 additions & 1 deletion docs/reference/transform/limitations.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -202,4 +202,29 @@ issue will occur.

If your data uses the <<date_nanos,date nanosecond data type>>, aggregations
are nonetheless on millisecond resolution. This limitation also affects the
aggregations in your {transforms}.
aggregations in your {transforms}.

[discrete]
[[transform-data-streams-destination]]
== Data streams as destination indices are not supported

{transforms-cap} update data in the destination index which requires writing
into the destination. <<data-streams>> are designed to be append-only, which
means you cannot send update or delete requests directly to a data stream. For
this reason, data streams are not supported as destination indices for
{transforms}.


[discrete]
[[transform-ilm-destination]]
== ILM as destination index may cause duplicated documents

<<index-lifecycle-management,ILM>> is not recommended to use as a {transform}
destination index. {transforms-cap} update documents in the current destination,
and cannot delete documents in the indices previously used by ILM. This may lead
to duplicated documents when you use {transforms} combined with ILM in case of a
rollover.

If you use ILM to have time-based indices, please consider using the
<<date-index-name-processor>> instead. The processor works without duplicated
documents if your {transform} contains a `group_by` based on `date_histogram`.

0 comments on commit bfbd616

Please sign in to comment.