XML Example

[yesoreyeram]

XML Example

URL : https://gist.githubusercontent.com/yesoreyeram/655a362eed0f51be24e16d3f1127a31d/raw/aa58549a5cf9d06dae1204b5a09be5d651adc744/text.xml

As you can see in the below image, the above xml can be visualised in grafana table in few simple steps. First you need to specify url of the xml, then specify the root/rows value and then finally columns.

If your rows are directly under the root node, you can specify the rows as shown below. In my example I want to list all the CDs in the CATALOG. So my root node is CATALOG.CD. Then for columns, I can specify each column and its type as shown below

XML Example with time columns

With the same url above, we are going to parse the Year as time column.

XML Example with time column

URL : https://thingspeak.com/channels/38629/feed.xml

in the below example, I want to visualise thingspeak traffic sensor data. As per the above xml, my feed data is two level down to the root node. So my root/rows selector is channel.feeds[0].feed. So I am trying to list all the feed data.

In the above example, you can see timestamp have very special selector created-at[0]._. because that node have a very specific property called type="dateTime"

XML with deep level of nodes

In the above example, user used xml.meter[0].profile[0].sample as the root node

XML - Simulating Timeseries

In the below example we don't have any time column. With just string column and one or more number columns, we can format the data as timeseries and then visuzalise in grafana's timeseries panels like guage, bar chart, stats panel etc.

[PolliniG]

Hi how are you? very good your git. I need your help.
Can I do this with my infinity?

[yesoreyeram]

since this is not a array data, you can simply define fields like this.

for the following xml

<DummyResponse xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns="https://xxxx">
    <appserver>OK</appserver>
    <dbserver>OK</dbserver>
     <authserver>OK</authserver>
</DummyResponse>

[PolliniG]

Sorry for being repetitive, but it does not work for me with the following parameters.

[yesoreyeram]

As i said, you are using older version of the plugin. You may need to update. Also change the Viz type to table to confirm if you are reading data. ( Note: Your data structure doesn't have any time stuff. So will not work with graphs. )

[PolliniG]

Hello friend, update the version of infinity and now it returns me this message

[yesoreyeram]

Sorry for the delayed response. Can you check the query inspector which gives you the corresponding curl command executed?. With the curl command you can manually verify that the plugin builds a correct url or not.

[akang-donai]

Hi, I have sample like in "XML with deep level of nodes", when I tried, it doesn't work.

[yesoreyeram]

this one? (but the date field, I couldn't get as timestamp. also Object nodes differ on each item.. So doesn't recognized as array ). But just able to retrieve the data.

[akang-donai]

I See, do the timestamp mandatory?

[akang-donai]

One more thing, the URLs, can it be with wildcard? because the XML filename are different, generated by the IoT

[yesoreyeram]

timestamp is mandatory if you want to render data in certain panels like timeseries. for table kind of panels doen't.

URLs can't be wildcards. There is no way grafana know how to expand them into actual url.

[MKardin]

Hi, I have a XML-file in a format with some
I view the first line in the table, but not the data for the second, third and fourth data-set.
What can I do to see the 4 data-sets?

report.txt

[gdiana]

👍

[MKardin]

Yesterday, we installed the latest datasource update (0.8.8). It appears the Query error message.
I try the new # comment feature in the uql-statement, but the query error message appears.
In attach the Data, UQL-Statement and a video with the comment feature.
[Explore_DataAndUQL.txt](https://github.com/yesoreyeram/grafana-infinity-datasource/files/8563676/Explore_DataAndUQL.t

20220426Commentsymbol.mp4

xt)

[yesoreyeram]

It doesn't seems you are using 0.8.8 ( may be cache effect/ require restart of grafana ). In 0.8.8 some UQL keywords will be shown in purple and blue as shown below. Can you try this?

[yesoreyeram]

also if you commented out the first line parse-xml, plugin doesn't know that it is xml. so keep that line uncommented.

[MKardin]

Thanks. Now, we are using 0.0.8 and it works.

[hardeepsingh3]

Is there a way to use the XML type to query against DNS bind statistics channel? I keep getting a no data error when using the URL that is assigned to that channel. I understand that pointing it to the UI is not the same as using inline raw data

[yesoreyeram]

There is no much difference between inline and URL.. when using XML you need to select fields correctly.. or change the parser to backend to see data.. then work from there..

[hardeepsingh3]

Thanks for your reply, I was not able to fetch the data from the URL. I have added two screenshots, the first one showing the grafana dashboard not displaying any data with the URL I am using and the second screenshot showing the data the URL shows when accessed on my local browser.
Screenshot 1:

Screenshot 2:

Is the DNS statistics-channels not compatible with this plugin?

[abhishek-kgn]

Are there any documentation for UQL for xml?
I am new to this,

[gdiana]

Yes, you may use the UQL command parse-xml which will convert XML to JSON. UQL uses JSON and the parse command converts other formats to JSON It also allows you to use JSONATA which is also very powerful Kind regards Gregory Diana

…

_______________________________________ [https://ci3.googleusercontent.com/mail-sig/AIorK4w8GeDRCVvd0gKIJQRTNPIzZwaNVVO5gun5JIFvzJNUo-FsSEeTHErnI-bK3YQEvlPZXv8fsk4] [https://mail.google.com/mail/u/0/?ui=2&ik=621c1f6941&attid=0.1&permmsgid=msg-f%3A1757970687899992335&th=18659106c9d4010f&view=fimg&fur=ip&sz=s0-l75-ft&attbid=ANGjdJ-LnFVYeAxg5roAQ9Rw7ul7w7DZQj-SJkiRXqk8BijUlyXFfBZC78SRV7XDB_FF103bDC0FAzps8amLSS3etoZbIH7zOjLsEUq_KY7_MlnmLmiT9nTSm0Ne5EM&disp=emb] www.expoenergy.co.za [https://mailtrack.io/trace/link/e82ab423593d9a0df17d6d51e93c685c913e9449?url=http%3A%2F%2Fwww.expoenergy.co.za&userId=1419085&signature=c6f337a62d2728d9]  22 Glen Grove Glenwood Durban 4001 Phone(h&w):031-2616761 (h) Fax2Email: 086 474 3450 Cell: 0784515277 E-mail: ***@***.*** ***@***.*** E-mail: ***@***.*** ***@***.***  Skype: gregory.diana Print: ***@***.*** ***@***.***  [data:image/gif;base64,R0lGODlhAQABAIAAAP///wAAACwAAAAAAQABAAACAkQBADs=3D]

On Sat, 3 Jun 2023 at 00:14, abhishek-kgn ***@***.***> wrote: Are there any documentation for UQL for xml? I am new to this, — Reply to this email directly, view it on GitHub [#37 (comment)], or unsubscribe [https://github.com/notifications/unsubscribe-auth/ADGSQIHR3BROYSSX5XJ53XDXJJQTRANCNFSM4X3JDYQQ]. You are receiving this because you commented.[https://ci4.googleusercontent.com/proxy/XkWTkYzdLS91Sw6HKobBBrkpeoIzSEDk6h4A58ZKz_at1rwussCIljN9AZRt-FKt83Z-uwBvpPHqXeUmID3YKrWOT8yo05rag9HnyPP_pHVW09rKbrCw9NPOAGlNd2A4hs0tD9klFdNFlaEpJ1HcafVFgnYIxWaHrSV2wLA5iVohkhrGycHnENRBWqgJ_PJ91F_WTGxilxNFhGFg7ri9wT-sjQZWYG1id_8miEkF7_tMl7CzugGp=s0-d-e1-ft#https://github.com/notifications/beacon/ADGSQIHTBSWZSQ55M5E4H7DXJJQTRA5CNFSM4X3JDYQ2YY3PNVWWK3TUL52HS4DFWFCGS43DOVZXG2LPNZBW63LNMVXHJKTDN5WW2ZLOORPWSZGOABOLMYY.gif]Message ID: <yesoreyeram/grafana-infinity-datasource/repo-discussions/ ***@***.***>

[abhishek-kgn]

Thanks that helped.
But now I am stuck with below task;

I am have a column that has IPs from two subnets; and I need to replace that as shown below
eg.
11.123.234.xxx --->AB12
11.123.56.xxx --->C34

I tried using substr and replace, but it looks like that do not work together in replace when I did something "Final_col"=replace_string("substring("col1",1,5)",'src','replacer');
how can this be done using jsonata?

[gdiana]

To do this you can use the JSONATA EXERCISER or editor. You can use an online XML to JSON converter and then cut and paste JSON into the JSONATA editor and see what is required to do what you want to do.

https://try.jsonata.org/

Note in JSONATA editor you may use multiple lines but in infinity UQL it must be a single line

[gdiana]

You can use the JSONATA Execciser (https://try.jsonata.org/).

Cut and paste JSON in LH Window. Enter JSONATA commands in the top RH window and display the result in the bottom RH window.

It is a very powerful tool but requires a lot of learning.

Not in the Excerciser one may use multiple lines but in Infinity UQL it must all be on a single line.

[yesoreyeram]

You can also use the XML+BackendParser+MultilineJsonata as a root selector.

[gdiana]

That is great to know. I have not used it for some time now.