Questions tagged [json]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
6 views

A good way to normalize data with very low variations

What is a good way to normalize a data that has so little variations? here are two examples: ...
user avatar
1 vote
0 answers
67 views

Plotly Express Choropleth Map Animation loading extremely long

I am making an animated choropleth map of regions in Czechia. When I run it without the animation, purely on one set of the data it takes 7.5 seconds. Here is the code for that. However when I tried ...
user avatar
3 votes
1 answer
60 views

How do I normalize json data into pandas (Covid-19 data) [closed]

I am trying to import all up-to-date datasets in JSON format on the covid-19 pandemic into a pandas dataframe. I believe it should be possible by using ...
user avatar
0 votes
1 answer
253 views

Extracting the metadata form Json file making it columns

I have the following json data file which I have converted to pandas dataframe. The columns are as follows ...
user avatar
  • 105
0 votes
0 answers
19 views

320GB `YYYY/MM/DD/HH/*.json.gz` -> `YYYY/MM/tenant_id=x/data.parquet`?

I have 1mil gzipped files which contain in total 350mil \n separated json objects. 26GB compressed, ~320GB uncompressed, representing 7 years of data for a multi-...
user avatar
0 votes
0 answers
123 views

How to rename different level entries of deeply nested JSON data into a single name so the values populate the same renamed column

I am trying to flatten a deeply nested JSON data and converting it into a csv using Pandas dataframe. I am able to do this but I am getting column names as entry_0_resource_code_coding_0_code, ...
user avatar
0 votes
0 answers
53 views

Issue while reading a csv file through Spark

I am trying to read a csv file through Spark. However one of the columns has the data in the below format and because of comma it is being split into multiple columns. The input csv file is a comma ...
user avatar
0 votes
1 answer
134 views

Extract data from json format and paste to column using python

In my column with json data, I have this list I want to extract to column: ...
user avatar
  • 15
2 votes
1 answer
36 views

Problem reading python code

Can someone explain the following python code. value_geojson["features"][0]["properties"]["title"] value_geojson is a geojson ...
user avatar
  • 123
0 votes
1 answer
412 views

parsing dictionary to JSON [closed]

I used the following code to pass a json string as a parameter in requests.post method, ...
user avatar
  • 135
0 votes
1 answer
79 views

conversion of dictionary to json to be sent to requests.post

I have a data frame like this. df=pd.DataFrame({'sub1':[10,20,30,40],'sub2':[5,10,15,20],'sub3':[1,2,3,4]}) and a dictionary like this. ...
user avatar
  • 135
1 vote
3 answers
6k views

Convert json to dataframe in python

I have a json array f below format ...
user avatar
  • 111
1 vote
0 answers
134 views

Python and data analysis how can we transform a json array into rows having json properties as columns titles?

I need to create a recommendation system for a small company using its 500 first orders. I received a .json file having the following structure: ...
user avatar
  • 163
1 vote
0 answers
20 views

Tool/Technology/Framework to process file with 1GB [closed]

I'm new to datascience, but I have the following problem: 1) Read a file of 1GB, which each line is a json object 2) There are two more files, much smaller, which I need to JOIN some data In this ...
user avatar
1 vote
1 answer
26k views

How to save API data into CSV format?

Is there an easy way to convert API data with python commands and output the results in CSV format? Here's what I'm doing now: ...
user avatar
  • 2,267
0 votes
1 answer
156 views

Accessing Flask WS APIs over intranet -

I have 2 scripts - A.py and B.py, and both are Flask apps. A.py renders a web page and acts as my UI taking inputs from user. B.py is hold the main logic and has a web service API being called by A.py....
user avatar
  • 431
1 vote
1 answer
185 views

SQL and JSON database - R

I have a database (PostgresSQL) which looks like this: ...
user avatar
  • 11
3 votes
1 answer
17k views

Load large .jsons file into Pandas dataframe

I'm trying to load a large jsons-file (2.5 GB) into a Pandas dataframe. Due to the large size of the file pandas.read_json() will result in a memory error. ...
user avatar
  • 81
0 votes
1 answer
28 views

How can I use a multivariable list of strings as a single X variable / feature in a Neural Network Model

Here is an example of what I am trying to do. I am using a bunch of X variables to predict a Y. X1 = Number of days since applying first medication X1.1 = Total times the medication should have ...
user avatar
  • 1
5 votes
1 answer
8k views

Python & Pandas : TypeError: to_sql() got an unexpected keyword argument 'flavor'

I want to store JSON Data into MySQL Database using Python. I used dataframe of pandas. I found that ...
user avatar
  • 155
1 vote
1 answer
187 views

Python equivalent of Wolfram Language Query for JSON?

The Wolfram Language has a Query function that can traverse data structures and apply functions at different levels of the structure. I am working with multi-level ...
user avatar
  • 695
2 votes
1 answer
2k views

Keras save model FailedPreconditionError

Model works and fits. After adding model.save('model.h5'). I am receiving ...
user avatar
  • 103
0 votes
1 answer
1k views

Prepare JSON data from sentiment analysis to perform Logistic Regression

I'm new to this field, so very sorry for this basic question. I'm working on a text analysis project using Google's NLP API along with some other APIS. After performing the sentiment analysis I have ...
user avatar
2 votes
1 answer
59k views

AttributeError: 'str' object has no attribute 'keys'

While converting json file to csv,I got the above error My code is shown below: ...
user avatar
  • 53
0 votes
1 answer
62 views

Convert graph database relationships into node properties [closed]

I have a neo4j database that stores forum posts. Replies to specific posts are encoded using a replyto relationship. I am trying to retrieve all the information ...
user avatar
2 votes
0 answers
14k views

How to Process Large JSON Files with Python [closed]

I've been using Python for quite some time now, scripting command line tools, etc. I'm just now moving to Data Analysis with the language; are there any tips for handling larger json files. ...
user avatar
0 votes
1 answer
16k views

Converting Json file to Dataframe Python

I have a json file which has multiple events, each event starts with EventVersion Key. The data looks similar to the following synthesized data. ...
user avatar
  • 151
0 votes
1 answer
819 views

clustering JSON data into three clusters, based on single attribute, using python

With data that looks like this: ...
user avatar
1 vote
1 answer
586 views

Running SQL-like queries over large schemaless JSON dataset in the cloud?

I've got about 5 million JSON files, about 50GB in total. They do not have a consistent schema (they're broadly the same format, but some have extra extension fields, some have missing fields, etc - ...
user avatar
  • 111
2 votes
1 answer
1k views

Ingestion of periodic REST API Calls into Hadoop [closed]

We are planning to use REST API calls to ingest data from an endpoint and store the data to HDFS. The REST calls are done in a periodic fashion (daily or maybe hourly). I've already done Twitter ...
user avatar
1 vote
3 answers
14k views

Unable to open .json file in pandas

I want to convert a json file into a dataframe in pandas (Python). I tried with read_json() but got the error: ...
user avatar
-3 votes
1 answer
409 views

Keras Import Error [closed]

While importing keras (from keras.models import Sequential), I am getting the following error: ...
user avatar
  • 1
1 vote
2 answers
869 views

What is a good way to start Data Analysis of unknown dataset (JSON data) [closed]

I am working with an organization to analyse their data residing in Mongodb and to look for any trends/patterns in the data. I am quite new to the professional field of Data Analysis but have a good ...
user avatar
  • 191
1 vote
1 answer
7k views

How to read Several JSON files to a dataframe in R?

I have a folder with 30,000 plus JSON file. A sample file with contents is posted below. ...
user avatar
  • 417
6 votes
1 answer
363 views

Database options for JSON storage, queried with Apache Drill

I am planning to set up a JSON storage system. It will store tens of millions of JSON records, all in the same format. I'd like to be able to query the data using Apache Drill. It looks like there is ...
user avatar