Questions tagged [json]
The json tag has no usage guidance.
35
questions
0
votes
0
answers
6
views
A good way to normalize data with very low variations
What is a good way to normalize a data that has so little variations?
here are two examples:
...
1
vote
0
answers
67
views
Plotly Express Choropleth Map Animation loading extremely long
I am making an animated choropleth map of regions in Czechia. When I run it without the animation, purely on one set of the data it takes 7.5 seconds. Here is the code for that.
However when I tried ...
- 11
3
votes
1
answer
60
views
How do I normalize json data into pandas (Covid-19 data) [closed]
I am trying to import all up-to-date datasets in JSON format on the covid-19 pandemic into a pandas dataframe. I believe it should be possible by using ...
- 31
0
votes
1
answer
253
views
Extracting the metadata form Json file making it columns
I have the following json data file which I have converted to pandas dataframe. The columns are as follows
...
- 105
0
votes
0
answers
19
views
320GB `YYYY/MM/DD/HH/*.json.gz` -> `YYYY/MM/tenant_id=x/data.parquet`?
I have 1mil gzipped files which contain in total 350mil \n separated json objects. 26GB compressed, ~320GB uncompressed, representing 7 years of data for a multi-...
0
votes
0
answers
123
views
How to rename different level entries of deeply nested JSON data into a single name so the values populate the same renamed column
I am trying to flatten a deeply nested JSON data and converting it into a csv using Pandas dataframe. I am able to do this but I am getting column names as entry_0_resource_code_coding_0_code, ...
0
votes
0
answers
53
views
Issue while reading a csv file through Spark
I am trying to read a csv file through Spark. However one of the columns has the data in the below format and because of comma it is being split into multiple columns. The input csv file is a comma ...
- 147
0
votes
1
answer
134
views
Extract data from json format and paste to column using python
In my column with json data, I have this list I want to extract to column:
...
- 15
2
votes
1
answer
36
views
Problem reading python code
Can someone explain the following python code.
value_geojson["features"][0]["properties"]["title"]
value_geojson is a geojson ...
- 123
0
votes
1
answer
412
views
parsing dictionary to JSON [closed]
I used the following code to pass a json string as a parameter in requests.post method,
...
- 135
0
votes
1
answer
79
views
conversion of dictionary to json to be sent to requests.post
I have a data frame like this.
df=pd.DataFrame({'sub1':[10,20,30,40],'sub2':[5,10,15,20],'sub3':[1,2,3,4]})
and a dictionary like this.
...
- 135
1
vote
3
answers
6k
views
1
vote
0
answers
134
views
Python and data analysis how can we transform a json array into rows having json properties as columns titles?
I need to create a recommendation system for a small company using its 500 first orders.
I received a .json file having the following structure:
...
- 163
1
vote
0
answers
20
views
Tool/Technology/Framework to process file with 1GB [closed]
I'm new to datascience, but I have the following problem:
1) Read a file of 1GB, which each line is a json object
2) There are two more files, much smaller, which I need to JOIN some data
In this ...
- 113
1
vote
1
answer
26k
views
How to save API data into CSV format?
Is there an easy way to convert API data with python commands and output the results in CSV format?
Here's what I'm doing now:
...
- 2,267
0
votes
1
answer
156
views
Accessing Flask WS APIs over intranet -
I have 2 scripts - A.py and B.py, and both are Flask apps.
A.py renders a web page and acts as my UI taking inputs from user.
B.py is hold the main logic and has a web service API being called by A.py....
- 431
1
vote
1
answer
185
views
3
votes
1
answer
17k
views
Load large .jsons file into Pandas dataframe
I'm trying to load a large jsons-file (2.5 GB) into a Pandas dataframe. Due to the large size of the file pandas.read_json() will result in a memory error.
...
- 81
0
votes
1
answer
28
views
How can I use a multivariable list of strings as a single X variable / feature in a Neural Network Model
Here is an example of what I am trying to do.
I am using a bunch of X variables to predict a Y.
X1 = Number of days since applying first medication
X1.1 = Total times the medication should have ...
- 1
5
votes
1
answer
8k
views
Python & Pandas : TypeError: to_sql() got an unexpected keyword argument 'flavor'
I want to store JSON Data into MySQL Database using Python.
I used dataframe of pandas. I found that ...
- 155
1
vote
1
answer
187
views
Python equivalent of Wolfram Language Query for JSON?
The Wolfram Language has a Query function that can traverse data structures and apply functions at different levels of the structure. I am working with multi-level ...
- 695
2
votes
1
answer
2k
views
Keras save model FailedPreconditionError
Model works and fits. After adding model.save('model.h5'). I am receiving
...
- 103
0
votes
1
answer
1k
views
Prepare JSON data from sentiment analysis to perform Logistic Regression
I'm new to this field, so very sorry for this basic question.
I'm working on a text analysis project using Google's NLP API along with some other APIS. After performing the sentiment analysis I have ...
- 101
2
votes
1
answer
59k
views
AttributeError: 'str' object has no attribute 'keys'
While converting json file to csv,I got the above error
My code is shown below:
...
- 53
0
votes
1
answer
62
views
Convert graph database relationships into node properties [closed]
I have a neo4j database that stores forum posts. Replies to specific posts are encoded using a replyto relationship. I am trying to retrieve all the information ...
2
votes
0
answers
14k
views
How to Process Large JSON Files with Python [closed]
I've been using Python for quite some time now, scripting command line tools, etc. I'm just now moving to Data Analysis with the language; are there any tips for handling larger json files. ...
- 21
0
votes
1
answer
16k
views
Converting Json file to Dataframe Python
I have a json file which has multiple events, each event starts with EventVersion Key. The data looks similar to the following synthesized data.
...
- 151
0
votes
1
answer
819
views
clustering JSON data into three clusters, based on single attribute, using python
With data that looks like this:
...
- 191
1
vote
1
answer
586
views
Running SQL-like queries over large schemaless JSON dataset in the cloud?
I've got about 5 million JSON files, about 50GB in total. They do not have a consistent schema (they're broadly the same format, but some have extra extension fields, some have missing fields, etc - ...
- 111
2
votes
1
answer
1k
views
Ingestion of periodic REST API Calls into Hadoop [closed]
We are planning to use REST API calls to ingest data from an endpoint and store the data to HDFS. The REST calls are done in a periodic fashion (daily or maybe hourly).
I've already done Twitter ...
- 29
1
vote
3
answers
14k
views
Unable to open .json file in pandas
I want to convert a json file into a dataframe in pandas (Python). I tried with read_json() but got the error:
...
-3
votes
1
answer
409
views
Keras Import Error [closed]
While importing keras (from keras.models import Sequential), I am getting the following error:
...
- 1
1
vote
2
answers
869
views
What is a good way to start Data Analysis of unknown dataset (JSON data) [closed]
I am working with an organization to analyse their data residing in Mongodb and to look for any trends/patterns in the data. I am quite new to the professional field of Data Analysis but have a good ...
- 191
1
vote
1
answer
7k
views
How to read Several JSON files to a dataframe in R?
I have a folder with 30,000 plus JSON file. A sample file with contents is posted below.
...
- 417
6
votes
1
answer
363
views
Database options for JSON storage, queried with Apache Drill
I am planning to set up a JSON storage system. It will store tens of millions of JSON records, all in the same format. I'd like to be able to query the data using Apache Drill.
It looks like there is ...
- 1,149