Questions tagged [databases]

A comprehensive collection of related data organized for convenient access, generally associated with software to update and query the data.

Filter by
Sorted by
Tagged with
1
vote
2answers
58 views

Merging two datasets with unclear identifier in Excel

I'm trying to merge two datasets on Mergers & Acquisitions. They both consist of c.10'000 observations with c.50-100 variables each. One contains information about the actual M&A deal whereas ...
1
vote
0answers
31 views

System administration skills for data engineering [closed]

As a data scientist student, I will do an internship with a lot of data engineering tasks. It would be good if I had some initiation skills in sys-admins. This leads me to my questions: Why should ...
1
vote
2answers
180 views

ML model deployment architecture?

I came from a software development background and we have separate servers of the same database (dev, test, prod). The reason for this is because we develop our apps against the dev DB, run tests ...
1
vote
1answer
11 views

Text Dataset Help: Need to figure out how to get the publication date of a text

I am a highschool student working on a science fair project in which me and a friend plan to use a neural network for a classification problem. In this case the thing classified will be text and the ...
1
vote
1answer
542 views

Connect Orange 3.20 to postgresql database

I installed orange 3.20 on windows 7. It works so far, the problem is connecting it to a server based Postgres database. While the connection can be made in the moment, when you try to load a table ...
1
vote
0answers
41 views

Database System for Manual Entry

I'm in charge of setting up a patient register (100K+ patients) for a non-profit project with little money. This register should provide the basis for later datascience. I'm not sure how a good ...
1
vote
0answers
34 views

Database for storing nested s3 objects from broom, sweep, or tidy in R

I'm working on a product that requires automated forecasting of time-series data in R & Shiny. Using R's sweep, broom, & tidy packages, I get these 'tibbles', which are like dataframes with ...
1
vote
0answers
3k views

Not enough replicas available for query at consistency all (2 required but only 1 alive)

I have a Cassandra cluster of 2 nodes and a keyspace "test" with a replication factor of 2. The consistency level is All. I am running a spark job which dumps data in Cassandra database. So, the ...
1
vote
1answer
402 views

Is there a term for “this month last year” in a report? [closed]

I'm building a report that has month over month data, but also "this month last year". Is there a better/standard way of describing this?
1
vote
0answers
62 views

Analytics oriented database

I'm analyzing a single large table (about 50GB 16M rows, 15 columns perhaps more) currently using PostgreSQL 9.4. Most of my queries doesn't involve more tables. Queries run time are very large. I'm ...
1
vote
1answer
791 views

Overcome memory limitation when downloading from database into Orange

I would like to run the association rule mining algorithm of the Orange library on a dataset that is stored in a PostgreSQL database. The table 'buildingset' contains the itemsets for each user, thus ...
1
vote
0answers
747 views

R-Cassandra connection with RJDBC

I am trying to connect with cassandra in R using RJDBC. When I execute casscon <- dbConnect(cassdrv, "jdbc:cassandra://ipaddrs:9160/demodb") I am getting <...
0
votes
1answer
175 views

is there big difference between data Science , big Data and database? [closed]

is there big difference between data Science , big Data and database? i am confused in these three can anyone help me to out of this confusion?
0
votes
4answers
83 views

How should we manage large database

We currently manage a large volume of economic data in Excel in my organisation. All of the data is downloaded from different online databases into Excel spreadsheets (one for each data frequency ...
0
votes
3answers
3k views

@RISK Vs R. Monte Carlo simulation in R?

Are there any cheaper or open source alternatives to @RISK or are there packages for R that would be able to perform the same tasks? http://www.palisade.com/risk/ @RISK (pronounced “at risk”) ...
0
votes
1answer
123 views

Will I be able to fetch a Data Analyst job if I learn everything in this image?

India Asking such a question because I am interested learn everything myself and I am confused about what to read. And I am interested by reading books, will that suffice? or should I compulsorily ...
0
votes
0answers
20 views

Image Dataset for course project

I am currently studying Machine Learning course and now we are requested ( each student ) to find an Image dataset to work on for the course project. I am new to ML and it's now a week and I am trying ...
0
votes
0answers
10 views

query category wise dara

I have stored the some products and there respective category in sql. Like this. Now I want fetch all product from table with respective category. output should be=>
0
votes
0answers
7 views

How to store and query biometric data for an authentication system?

I am trying to design, and hopefully implement, an authentication system which centers around the use of biometric images. I plan to use different machine learning and deep learning techniques to help ...
0
votes
0answers
15 views

Machine Learning Recommender high data intensity

We are building a recommender engine to be integrated in an app that, each time an API is called, will pull thousands of records from an Azure SQL database and create recommendations. Currently with ...
0
votes
0answers
13 views

Manually rollbacking JDBC transaction or just leaving it to the database

When managing transactions through JDBC, should I manually rollback if some exception occurs or leave it to the database to do the rollback on its own? The database in question is Postgresql. As far ...
0
votes
0answers
15 views

Data storage for Intrusion Detection System

I write an IDS(in C) for a KNX network for my thesis. For this, I just store all the telegrams within an SQLite database. But I'm not sure if a SQL database is the best here. I want to "ask ...
0
votes
0answers
94 views

Use Tableau with Graph Database Neo4j to Visualize Pickup and Dropoff Points in Different Colors

I'm tryin to visualize taxi trips in NYC with Tableau. I've stored the data in a graph database (Neo4J) and connected Tableau to the database via a JDBC connector. My problem is, that I want to ...
0
votes
1answer
23 views

Azure Cloud SQL - Querying large number of rows with Python

I have a Python Flask application that connects to an Azure Cloud SQL Database, and uses the Pandas read_sql method with SQLAlchemy to perform a select operation on a table and load it into a ...
0
votes
0answers
38 views

Database augmentation using Sobel filter (aka gradient)

I'm working in PyTorch and to improve a ProGAN training I'm augmenting a database by calculating, for each image, the horizontal and vertical gradient via the Sobel operator. Do you have any reading ...
0
votes
0answers
17 views

Project structure ML time-series forecasting

I'm about to start with a ML learning time-series forecasting project which includes large-quantities of (2-million) time-series stored in JSON-files. The first step will involve feature engineering....
0
votes
1answer
3k views

Replacing column values in pandas with specific column with multiple database operation?

Need to replace database of the column in specific refine query with multiple operations as mention in below image. Trying such operation as an individual, but can't understand which method to use can ...
0
votes
2answers
85 views

Database on time to churn in telecomunication

I would like to research about time to churn1 in the telecommunication market. Does anyone have a link to such a database? The only ones I found did not include the time of churn, but only if a ...
0
votes
1answer
63 views

Looking for a 'CITY, STATE' within a body of text (from a CITY-STATE database)

I'm looking for an optimal way to search a large body of text for a combination of words that resemble any CITY, STATE combination I have in a separate CITY-STATE database. My only idea would be to ...
-1
votes
1answer
25 views

How to document operations on a database? [closed]

I am working on a scientific article, where I am going to work with a large SQL based database. This work consist of everything from washing data, creating sub-databases etc. How can I document this ...
-1
votes
0answers
15 views

Here is the Case Study for Next Generation Database [closed]

How to Design an application which will have all operations like create, update, delete, display employees using MongoDB database. Front-end should be in HTML and CSS backend should be in PHP Design ...

1
2