Questions tagged [databases]

A comprehensive collection of related data organized for convenient access, generally associated with software to update and query the data.

17 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
2
votes
1answer
14 views

DBMS or Software for privacy sensitive data

We have a dataset of very privacy sensitive people data and want to build a database with it. The data protection department in our company doesn't like the idea that the data scientists are able to ...
2
votes
0answers
579 views

2D Image-based Avatar Animation With Expressions / Image-To-Image Translation

What I want to do Input an image-sequence (videoframes) that is already cropped and aligned to only the face/hair region and photorealistically replace this Person, Person A (can be anyone, I also ...
2
votes
0answers
2k views

Decode SQLite database blobs: how to start?

Updated: see bottom of this question. Not sure if I am at the right channel here but I have good hopes someone here might be able to help me. I am trying to process and analyse data from a Footscan ...
1
vote
1answer
17 views

I Have Issues Installing Basemap

I tried to install Basemap and it gives me this: preparing transaction: done verifying transaction: done executing transaction: failed ERROR conda.core.link:_execute(507): An error occurred while ...
1
vote
2answers
173 views

ML model deployment architecture?

I came from a software development background and we have separate servers of the same database (dev, test, prod). The reason for this is because we develop our apps against the dev DB, run tests ...
1
vote
0answers
38 views

Database System for Manual Entry

I'm in charge of setting up a patient register (100K+ patients) for a non-profit project with little money. This register should provide the basis for later datascience. I'm not sure how a good ...
1
vote
0answers
33 views

Database for storing nested s3 objects from broom, sweep, or tidy in R

I'm working on a product that requires automated forecasting of time-series data in R & Shiny. Using R's sweep, broom, & tidy packages, I get these 'tibbles', which are like dataframes with ...
1
vote
0answers
3k views

Not enough replicas available for query at consistency all (2 required but only 1 alive)

I have a Cassandra cluster of 2 nodes and a keyspace "test" with a replication factor of 2. The consistency level is All. I am running a spark job which dumps data in Cassandra database. So, the ...
1
vote
0answers
62 views

Analytics oriented database

I'm analyzing a single large table (about 50GB 16M rows, 15 columns perhaps more) currently using PostgreSQL 9.4. Most of my queries doesn't involve more tables. Queries run time are very large. I'm ...
1
vote
0answers
746 views

R-Cassandra connection with RJDBC

I am trying to connect with cassandra in R using RJDBC. When I execute casscon <- dbConnect(cassdrv, "jdbc:cassandra://ipaddrs:9160/demodb") I am getting <...
0
votes
0answers
14 views

Machine Learning Recommender high data intensity

We are building a recommender engine to be integrated in an app that, each time an API is called, will pull thousands of records from an Azure SQL database and create recommendations. Currently with ...
0
votes
0answers
13 views

Manually rollbacking JDBC transaction or just leaving it to the database

When managing transactions through JDBC, should I manually rollback if some exception occurs or leave it to the database to do the rollback on its own? The database in question is Postgresql. As far ...
0
votes
0answers
15 views

Data storage for Intrusion Detection System

I write an IDS(in C) for a KNX network for my thesis. For this, I just store all the telegrams within an SQLite database. But I'm not sure if a SQL database is the best here. I want to "ask ...
0
votes
0answers
75 views

Use Tableau with Graph Database Neo4j to Visualize Pickup and Dropoff Points in Different Colors

I'm tryin to visualize taxi trips in NYC with Tableau. I've stored the data in a graph database (Neo4J) and connected Tableau to the database via a JDBC connector. My problem is, that I want to ...
0
votes
1answer
19 views

Azure Cloud SQL - Querying large number of rows with Python

I have a Python Flask application that connects to an Azure Cloud SQL Database, and uses the Pandas read_sql method with SQLAlchemy to perform a select operation on a table and load it into a ...
0
votes
0answers
30 views

Database augmentation using Sobel filter (aka gradient)

I'm working in PyTorch and to improve a ProGAN training I'm augmenting a database by calculating, for each image, the horizontal and vertical gradient via the Sobel operator. Do you have any reading ...
0
votes
0answers
17 views

Project structure ML time-series forecasting

I'm about to start with a ML learning time-series forecasting project which includes large-quantities of (2-million) time-series stored in JSON-files. The first step will involve feature engineering....