Questions tagged [json]
The json tag has no usage guidance.
24
questions
1
vote
0answers
14 views
Tool/Technology/Framework to process file with 1GB
I'm new to datascience, but I have the following problem:
1) Read a file of 1GB, which each line is a json object
2) There are two more files, much smaller, which I need to JOIN some data
In this ...
0
votes
1answer
455 views
How to save API data into CSV format?
Is there an easy way to convert API data with python commands and output the results in CSV format?
Here's what I'm doing now:
...
0
votes
1answer
31 views
Accessing Flask WS APIs over intranet -
I have 2 scripts - A.py and B.py, and both are Flask apps.
A.py renders a web page and acts as my UI taking inputs from user.
B.py is hold the main logic and has a web service API being called by A.py....
0
votes
1answer
41 views
SQL and JSON database - R
I have a database (PostgresSQL) which looks like this:
""results"":
{""WEBS"":
{""WEBS_4"": [{""ip"": ""XXXXX"", ""value"": ""YYYY""}]}}
I would ...
1
vote
1answer
925 views
Load large .jsons file into Pandas dataframe
I'm trying to load a large jsons-file (2.5 GB) into a Pandas dataframe. Due to the large size of the file pandas.read_json() will result in a memory error.
...
0
votes
0answers
258 views
Better way to fix Json error: Invalid control character at: line 1 column 116 (char 115)
While running my script, to parse the Json file which I've done every month, but this time I got an error that says with a new set of data that say:
...
0
votes
0answers
40 views
JSON files as a datastore, and updating them
I am proposing dumping scraped classified adverts to JSON files in S3, for use with AWS Athena.
Question:
Currently, I use DynamoDB and update the listing object when the price changes or the ...
0
votes
1answer
23 views
How can I use a multivariable list of strings as a single X variable / feature in a Neural Network Model
Here is an example of what I am trying to do.
I am using a bunch of X variables to predict a Y.
X1 = Number of days since applying first medication
X1.1 = Total times the medication should have ...
3
votes
1answer
3k views
Python & Pandas : TypeError: to_sql() got an unexpected keyword argument 'flavor'
I want to store JSON Data into MySQL Database using Python.
I used dataframe of pandas. I found that ...
1
vote
1answer
124 views
Python equivalent of Wolfram Language Query for JSON?
The Wolfram Language has a Query function that can traverse data structures and apply functions at different levels of the structure. I am working with multi-level ...
2
votes
1answer
754 views
Keras save model FailedPreconditionError
Model works and fits. After adding model.save('model.h5'). I am receiving
...
0
votes
1answer
521 views
Prepare JSON data from sentiment analysis to perform Logistic Regression
I'm new to this field, so very sorry for this basic question.
I'm working on a text analysis project using Google's NLP API along with some other APIS. After performing the sentiment analysis I have ...
2
votes
1answer
38k views
AttributeError: 'str' object has no attribute 'keys'
While converting json file to csv,I got the above error
My code is shown below:
...
0
votes
1answer
34 views
Convert graph database relationships into node properties [closed]
I have a neo4j database that stores forum posts. Replies to specific posts are encoded using a replyto relationship. I am trying to retrieve all the information ...
2
votes
0answers
10k views
How to Process Large JSON Files with Python
I've been using Python for quite some time now, scripting command line tools, etc. I'm just now moving to Data Analysis with the language; are there any tips for handling larger json files. ...
0
votes
1answer
15k views
Converting Json file to Dataframe Python
I have a json file which has multiple events, each event starts with EventVersion Key. The data looks similar to the following synthesized data.
...
0
votes
1answer
570 views
clustering JSON data into three clusters, based on single attribute, using python
With data that looks like this:
...
0
votes
1answer
413 views
Running SQL-like queries over large schemaless JSON dataset in the cloud?
I've got about 5 million JSON files, about 50GB in total. They do not have a consistent schema (they're broadly the same format, but some have extra extension fields, some have missing fields, etc - ...
2
votes
1answer
897 views
Ingestion of periodic REST API Calls into Hadoop [closed]
We are planning to use REST API calls to ingest data from an endpoint and store the data to HDFS. The REST calls are done in a periodic fashion (daily or maybe hourly).
I've already done Twitter ...
1
vote
3answers
9k views
Unable to open .json file in pandas
I want to convert a json file into a dataframe in pandas (Python). I tried with read_json() but got the error:
...
-2
votes
1answer
386 views
Keras Import Error
While importing keras (from keras.models import Sequential), I am getting the following error:
...
1
vote
2answers
589 views
What is a good way to start Data Analysis of unknown dataset (JSON data) [closed]
I am working with an organization to analyse their data residing in Mongodb and to look for any trends/patterns in the data. I am quite new to the professional field of Data Analysis but have a good ...
0
votes
1answer
5k views
How to read Several JSON files to a dataframe in R?
I have a folder with 30,000 plus JSON file. A sample file with contents is posted below.
...
6
votes
1answer
292 views
Database options for JSON storage, queried with Apache Drill
I am planning to set up a JSON storage system. It will store tens of millions of JSON records, all in the same format. I'd like to be able to query the data using Apache Drill.
It looks like there is ...
