Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Time Series Viewer #1

Open
dinib opened this issue Nov 25, 2015 · 6 comments
Open

Time Series Viewer #1

dinib opened this issue Nov 25, 2015 · 6 comments

Comments

@dinib
Copy link

dinib commented Nov 25, 2015

test.txt
It would be really good to change the plugin so that time series from different data formats can be visualised too.

An example of different dataset is attached.

The first line can be skipped.
Second line contains dates.
Third line onward, the points of the dataset. Column 1 to 9: coordinates UTM, coherence, velocity, radar coord, lat long, residual topography. From column 9 onward, the temporal series.

@luipir
Copy link
Contributor

luipir commented Nov 26, 2015

I did an hackaton where I hacked ps-speed to manage something similar. Wasn't a simple hack because this is a change in the data structure.

the problem is that there isn't a strandard time textual time series format and it's not possibile to consider all cases.
For that reason there are instruments like Pandas and so on, that hare focused on data reorganization in DataFrames

managing DataFrame would be good, but I already tested that need a lot of user interaction to create a acceptable format (every data source is generally organised in different ways)

just to say that is not hard to adapt the code to your data... but is much more work to create a generic timeseries data ingestor flexible to all possibile data structures.

let me know

@luipir
Copy link
Contributor

luipir commented Nov 26, 2015

I can see that if layer is a shape is really similar to your format... can you convert that text in shape and try is?

@dinib
Copy link
Author

dinib commented Nov 26, 2015

Hello there,

thanks for your reply.

For what I can understand, I imagine that it is complicated to create a generic timeseries viewer which will be flexible for all types of data of this kind.

My idea was just to be really humble about this, to take advantage or the nice work you did and just adapt it at the best of my abilities just for the data format that I will be using.

The trouble is that I did not see (in the file that I thought contains the body of the code) where do you tell it where to get the temporal series from.

I get the file as a text table and then I save it as a shapefile. I tried with it as a shapefile at first and it did not work. So I looked at the sample data and realised that the attribute table is different, if nothing else, for how the fields are labelled and thought that that was why it did not work.. I tried to patch up by putting “false” names in the attribute table, to mimic the sample data. Initially it seemed to work, I clicked on a point and it showed something that looked like its temporal series. But for some reason I do not understand, it gets rid of a huge part of the data.

Thanks!

From: Luigi Pirelli [mailto:[email protected]]
Sent: Donnerstag, 26. November 2015 10:35
To: faunalia/ps-speed
Cc: Dini Benedetta
Subject: Re: [ps-speed] Time Series Viewer (#1)

I did an hackaton where I hacked ps-speed to manage something similar. Wasn't a simple hack because this is a change in the data structure.

the problem is that there isn't a strandard time textual time series format and it's not possibile to consider all cases.
For that reason there are instruments like Pandas and so on, that hare focused on data reorganization in DataFrames

managing DataFrame would be good, but I already tested that need a lot of user interaction to create a acceptable format (every data source is generally organised in different ways)

just to say that is not hard to adapt the code to your data... but is much more work to create a generic timeseries data ingestor flexible to all possibile data structures.

let me know


Reply to this email directly or view it on GitHubhttps://github.com//issues/1#issuecomment-159858250.

@luipir
Copy link
Contributor

luipir commented Nov 26, 2015

attach here your converted data in shape file

btw, I'm not the author of the plugin, so I've to infer how it works reading the code... but I'm confident it can be adapted....

please share con verted data

@dinib
Copy link
Author

dinib commented Nov 26, 2015

I cut the file drastically but it is still too large to send it by email. I created these dropbox links. I hope they work.

All I did was to import the text file (of which I attached sample in the ticket) and then “save as shapefile“

When you do this, it creates the 5 usual files.

https://www.dropbox.com/s/9pbx44z73lpzmnw/test1.shp?dl=0

https://www.dropbox.com/s/cozf7fj0u1vyt6z/test1.dbf?dl=0

https://www.dropbox.com/s/57242cpln8qphgi/test1.prj?dl=0

https://www.dropbox.com/s/8r8jpqtyl0t5t29/test1.qpj?dl=0

https://www.dropbox.com/s/ct6la4285vvv2tc/test1.shx?dl=0

From: Luigi Pirelli [mailto:[email protected]]
Sent: Donnerstag, 26. November 2015 12:19
To: faunalia/ps-speed
Cc: Dini Benedetta
Subject: Re: [ps-speed] Time Series Viewer (#1)

attach here your converted data in shape file

btw, I'm not the author of the plugin, so I've to infer how it works reading the code... but I'm confident it can be adapted....

please share con verted data


Reply to this email directly or view it on GitHubhttps://github.com//issues/1#issuecomment-159887341.

@dinib
Copy link
Author

dinib commented Dec 4, 2015

Hi there,

I was wondering whether you could see the shapefile that I had shared with a dropbox link and if you had any news about if (and how) it would be possible to adapt the PS-viewer.

Thank you,

Benedetta

From: Luigi Pirelli [mailto:[email protected]]
Sent: Donnerstag, 26. November 2015 12:19
To: faunalia/ps-speed
Cc: Dini Benedetta
Subject: Re: [ps-speed] Time Series Viewer (#1)

attach here your converted data in shape file

btw, I'm not the author of the plugin, so I've to infer how it works reading the code... but I'm confident it can be adapted....

please share con verted data


Reply to this email directly or view it on GitHubhttps://github.com//issues/1#issuecomment-159887341.

pcav pushed a commit that referenced this issue Jul 27, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants