Questions tagged [data-quality]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
49 views

How to exercise Quality Assurance Engineering principles to Artificial Intelligence systems?

In deterministic (software) systems we have a set of business requirements and ideally, given enough resources, such a system can be fully defined of which are the expected outputs for each inputs or ...
user avatar
5 votes
4 answers
382 views

Calculating Potential Usefulness of Acquiring Additional Data [closed]

Imagine Anne has a labeled training dataset for a machine learning prediction problem. There is an opportunity to acquire more data from an agent, at a cost. However, before she decides to acquire ...
user avatar
  • 59
0 votes
0 answers
17 views

Sensor data completeness

We have several sensors collecting data with a specified frequency (usually every 20 minutes but it varies) over a period of many years. The person that programmed them made sure, as a space saving ...
user avatar
0 votes
0 answers
11 views

does R2 diverge because of a lack of input dimensions?

I try to improve my R2 score between theoretical and real output values. On the picture you can see two cases: the blue one is an artificial case I’m completely mastering with 7 dimensions as input ...
user avatar
0 votes
0 answers
37 views

Reinforcement Learning vs Retraining

I have created a complex ML model using supervised learning. For the sake of discussion, let's say my model identifies dogs and a human labels the output as "correct" or "not correct&...
user avatar
0 votes
0 answers
10 views

what level of discrepancy do I target for a good interpolation?

I'm performing some interpolation comparison and, of course, "the quality" of the training sample is a key parameter to survey. In this case I can create the dataset. For this reason, I try ...
user avatar
1 vote
0 answers
13 views

Public information quality trends vs quantity

With the great increase of publically viewable information (content) supported by the internet and modern communications, is the average quality of that information decreasing, roughly static, or ...
user avatar
0 votes
0 answers
39 views

What are the metrics to evaluate Data Quality?

Data quality refers to the overall utility of a dataset(s) as a function of its ability to be easily processed and analyzed for other uses, usually by a database, data warehouse, or data analytics ...
user avatar
  • 2,376
0 votes
0 answers
23 views

How to mathematically quantify the quality of a corpus?

I am working on a text classification project. I have around 60,000 text samples of 40intents. By calculating the frequency of ...
user avatar
  • 111
1 vote
0 answers
15 views

UI-based Tool for Qualitative Evaluation of Data Quality

Dear DS StackExchange community, I'm currently searching the interwebs for a (near-)ready-to-use solution, to perform a qualitative evaluation of extracted features from video data. In my head the ...
user avatar