Questions tagged [geospatial]
pertaining to the geographic location and characteristics of natural or constructed features and boundaries on, above, or below the earth's surface; esp. referring to data that is geographic and spatial in nature.
86
questions
0
votes
0
answers
14
views
Generate evenly space point geography along a linestring
I have the total number of poles in a location (a sample area) and the road geometry (linestring) of each road in the area. I can calculate the average distance between poles, I want to distribute ...
- 1
0
votes
0
answers
9
views
Can a location be derived from a compilation of paintings?
I have added a link to the collected paintings that were put into a video below.
I apologize for the quality, I had to gif and reduce it to fit here. (The SE team may consider increasing the size ...
- 101
0
votes
1
answer
83
views
Is there a way to automatically split large clusters that are greater than some maximum number of points?
I ran HDBSCAN on these coordinates and got some clusters but some are too large. HDBSCAN has a minimum cluster size parameter, but no maximum size. All I want is to intuitively divide larger clusters ...
1
vote
0
answers
17
views
Loading large raster dataset in to tensorflow
I am building a convolutional neural network for processing air quality concentration fields and meteorological parameter distribution. The input data are in Geotiff and NetCDF formats, which I load ...
- 111
0
votes
0
answers
15
views
Multiple coords to one data_vars in xr.dataset
I am trying to create a xarray dataset for a list of events (labeled 1 or 0, so it's an array of integers). To each event three numbers need to be attached - a date, longitude, and latitude.
I provide ...
- 125
0
votes
0
answers
232
views
How to filter rows using custom function in pyarrow
I've a parquet dataset that contains latitude and longitude values as separate columns. And I want to filter those rows that are inside a polygon, I'm able to do this in pandas dataframe but unable to ...
- 101
2
votes
3
answers
454
views
How to forecast a timeseries with geolocation data?
I have created a dataset with my geolocations from the last three months. The data set contains longitude, latitude, and timestamp, with a frequency of every 5 minutes. Based on this data, I want to ...
- 93
0
votes
0
answers
37
views
Classification Algorithms for Geospatial Vector Data
I am new to the world of Geospatial Analysis.
As such, I am interested in Machine Learning / Deep Learning techniques for classifying geospatial vector data specifically (as opposed to raster data). I'...
5
votes
3
answers
293
views
Spatial Join Pandas Dataframes of Bounding Boxes (cross match)
Problem Statement
Imagine there are two almost identical images with annotations (bounding boxes for certain objects), where one is so-called golden image (template) containing all must-have objects (...
- 4,207
0
votes
1
answer
25
views
0
votes
0
answers
101
views
How to best train a CNN with longitude/latitude output
Problem
I am new to CNNs and I'm starting off with a geolocation problem where the input is an image and the output should be a longitude value and a latitude value.
I am unsure of the best way to ...
0
votes
1
answer
22
views
How to denoise overrepresented lines in sample of 2D (geospatial) data?
I have some geospatial data in lat/lon form accurate to 6th decimal place.
As shown in the picture below, there are some over-represented lines of points at specific latitudes which appear in the ...
- 155
1
vote
1
answer
59
views
Group people driving together based on GPS data
I need to group together people driving together based on GPS data. Data are collected by mobile phones. From each user we receive them in batches every 10 seconds. Each batch have list of GPS data (...
- 11
0
votes
0
answers
84
views
Hex-binning Geospatial Data
Okay, I feel like this maybe a very easy to answer for many of you. If you feel tempted to downvote this question, please know I tried earnestly for a dozen hours to find what I think should have been ...
- 101
1
vote
0
answers
23
views
What is purpose of diffusion matrix? What is its role in graph clustering? How do it serve its purpose by equation?
As titled, I am not quite sure what is purpose of Diffusion Matrix, which is support to clustering graph.
From this article (https://arxiv.org/pdf/2006.05582v1.pdf) I am might able to compute the ...
- 11
1
vote
0
answers
41
views
Filter relevant geojson data based on a selected datapoint
I'll outline the situation and challenge I have a bit more clearly. I have multiple different datasets:
A set of locations where products are sold (name, long, lat)
A geojson dataset with geometry (...
0
votes
1
answer
684
views
Clustering latitude, longitude along with numeric and categorical data
I am working on clustering the customer base of a business-to-business company.
I have data on customers that consists of both numerical (e.g. # of purchases made, avg. spend per purchase) and ...
- 101
1
vote
2
answers
295
views
Interpolate a point in time for two given geolocations and their times in python
Let's say I have two geolocations at given times. How can I interpolate these two geolocation and find any location for a given time time3 in python?
...
- 146
0
votes
0
answers
14
views
How to classify a "Trip" from multiple GPS pings of each Unique ID?
I have a huge file of lat/long & timestamp data from vehicles and I need to identify "Trips" from these multiple pings of Each vehicle ID. Trips have a "Start" & "end&...
- 1
0
votes
1
answer
32
views
Sampling from earths landmass
Given a sphere which resembles earth, I want to sample points where land would be. I am struggling to find a dataset to sample from, and even to find a dataset which I could use to generate a set of ...
- 3
2
votes
1
answer
49
views
How to use LAT/LNG as predictor variables
I'm working on geographic data where I need to predict the average income per geo key/zip code. The data I have consisted of more than 30 million unique geo keys in Zip+4 format. As per my ...
- 21
-1
votes
1
answer
399
views
How to deal with address (like zip-code) for training a model?
To me it doesn't make sense to normalize it even if it is a numerical variable like Zip Code. An address should be interpreted as categorical features like "neighborhood"... ?
Suppose I have ...
- 31
2
votes
0
answers
14
views
Machine learning cost/benefit for including priors in input vector
Is there a trade-off in accuracy/generalisation/performance when providing priors to a general machine learning algorithm vs training the machine learning algorithm with enough data so that it could ...
- 121
1
vote
0
answers
102
views
Can pre-trained transformers (I.e., BERT) handle numerical/spatial data
I’m curious to know if pre-trained transformers could handle search queries that include numerical data or make references to spatial relationships.
Take an example dataset of a list of restaurants, ...
- 93
0
votes
1
answer
26
views
use cases of geocoding maps
Tableau has interactive maps that can be used for custom geocoding. I know companies often divide regions for sales and marketing purposes but could anyone think of any specific use cases or examples ...
- 191
1
vote
0
answers
80
views
How to use Lat/Lon in machine learning prediction?
I am research meteorologist working with hurricane model forecasts of track (millions of lat/lon pairs) and their verified lat/lon pairs (essentially where the hurricane actually went).
With the ...
1
vote
1
answer
108
views
Geospatial clustering plot with zoom in Python?
I need to construct an interactive clustering plot. Ideally as the user zooms in the clusters would split-up into smaller clusters at certain zoom levels.
I am planning to have several discrete levels ...
- 111
0
votes
0
answers
40
views
Save CSVs as hyper file
I have three separate CSV files (Points.csv, PointsSynonym.csv, and LocalDataPoints.csv). I made these files after extracting data from shape files and .gpkg files.
I would like to save them all a ...
- 191
1
vote
0
answers
29
views
Metrics for spatial datasets
I'm working on a dataset of computer game replays. Each replay file describes the game of two players as a timeseries of game commands, where each command has a type and coordinates, like so: ...
- 143
1
vote
0
answers
21
views
What is a good way to handle nominal spatial data with a changing number of categories to use in prediction model?
For a project I'm going to be working with spatial data with a nominal attribute (land use). Every year the number of categories for this attribute changes because categories split or merge. I do have ...
0
votes
1
answer
31
views
Finding Correlations in two Datasets
I have an assignment where I am trying to find correlations between Lightning Strikes and Telecommunication damage. The two datasets consist of many columns (especially the human-recorded ...
- 13
1
vote
0
answers
32
views
Destination prediction with Naive Bayes and sparse output matrix
Given a dataset of historical cab rides, I'm trying to predict the final zip code destination of a ride based on the following features:
origin zip code (e.g. 10006 Wall Street, Manhattan)
pickup ...
- 165
0
votes
0
answers
67
views
How to handle multi-channel 2-D geo-spatial grid like data samples in machine learning with number of features associated with each grid?
I am looking into a problem wherein the whole geographic area is divided into number of bins/pixels so we get nxn matrix covering whole region. Now each bin/pixel has number of parameters/features ...
- 11
4
votes
1
answer
59
views
Spatially constrained geospatial similarity
What's the current methodology for clustering geospatial data by features?
Example: I have some demographic dataset. Let's say this contains average home price and population density.
So, an example ...
4
votes
2
answers
121
views
Data Engineering Stack - collect, transform and visualize geospatial data
I'm making a side project, where I collect geospatial data by web scrapping and from OSM API. I've started with simple Java application, however, I would like to make it as a data flow, purely for ...
- 141
1
vote
0
answers
37
views
Derivative of multi-output Gaussian Process
I am working on a project where I estimate transition and measurements models for a kalman filter using Gaussian Processes.
In order to linearize the models I require the Jacobian of the estimated ...
- 21
2
votes
1
answer
88
views
Geo Add-on Choropleth Widget not found
I am trying to create a Choropleth map using the Chorolpeth widget from the Geo Add-on in Orange. However, this widget is not appearing? Any ideas?
My current version: Orange version 3.24.1 for ...
0
votes
1
answer
16
views
How to measure the distance (in generalized sense) between geographical regions? [closed]
I need to construct a distance matrix for a few U.S. counties that are adjacent to one or another, and choosing the definition of distance is very tricky. The shortest path (i.e the minimum number of ...
- 145
1
vote
0
answers
45
views
"Smearing" probabilities or how to handle imprecise locations for canonically classification-type problems
I am trying to predict failures at different nodes on a line. Each node has different weather features and hardware/configuration features. For a little under half of the historical failures I have, I ...
- 11
0
votes
1
answer
23
views
Train building classifier for imagerial data
I am using the https://www.arcgis.com/ api for accessing imagery of aerial data.
I would like to train a model that can caputure on the imagery if the provided ...
- 187
0
votes
0
answers
92
views
How to plot a world map with cities in the right locations?
The data source is a CSV with cities in various countries in the world, each city has some numeric data associated with it. df.columns looks like:
...
- 1,100
1
vote
3
answers
194
views
How to best use geographical information as a factor?
I am trying to predict crime rates and I have naively used lat and long as two separate factors (which seem to work well!). Are there any best practices for location as a factor?
- 139
-1
votes
1
answer
218
views
Can a machine learning model be trained on Call Detail Record(CDR) Data to predict user's daily locations?
I have a CDR data for two months and my goal is to extract daily or frequent locations(cell towers) of the user along with the departure and arrival time on those locations. The spatial resolution of ...
- 101
0
votes
2
answers
99
views
Is there an alternative to Google Maps to find GPS coordinates of a place in Germany?
For probably any place on Earth, you can search it in Google Maps, make right-click, pick the option "What's here" and you get GPS coordinates.
If I don't want to use Google Maps API, is there an ...
- 381
0
votes
1
answer
48
views
Unsupervised Learning::Satellite Images::Single Bands
Has anyone has success with building models using KMeans for classification? I have images that only have one band and it continues to fail. My guess is that the issue is with both size of the image ...
- 133
0
votes
1
answer
18
views
fast processing: changing the column value in a geospatial environment
I have a table whose header looks like this: complaint_type, borough, street_name, incident_zip, latitude, longitude
1) I want to check if the "incident_zip" column of each row is in a specific list ...
- 11
1
vote
1
answer
341
views
Changing the value of a column based on the condition on another column
I have a table whose header looks like this:
complaint_type borough street_name incident_zip latitude longitude
I want to check if the "incident_zip" column of each row is in a specific ...
- 11
0
votes
1
answer
180
views
How do I get the latitude and longitude information contained csv file? [closed]
I have already done a project on "Segmenting and Clustering Neighborhoods in Toronto" using the latitude and longitude information contained CSV file link attached with the question[http://cocl.us/...
- 101
1
vote
0
answers
27
views
High Level Discussion: Generate synthetic sensor data using data from surrounding sensors
Let's assume I have readings coming from sensors. For every sensor, I have the following information:
all the data it reads
its location
Now, given an arbitrary sensor at an arbitrary location ...
- 11
0
votes
0
answers
91
views
GPS Data Preprocessing Recommandations?
GPS Data Preprocessing
I got gps traces of busses which traveled from one place (bus station) to another. This file contains relevant(eg:- Data recorded between the starting bus station and ends ...
