Questions tagged [parsing]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
16 views

RAM crashed for XML to DataFrame conversion function

I have created the following function which converts an XML File to a DataFrame. This function works good for files smaller than 1 GB, for anything greater than that the RAM(13GB Google Colab RAM) ...
0
votes
1answer
17 views

Constituency vs Dependency Parsing: What is more effective for Sentiment Analysis?

Parsing is often used to understand the sentiment of complex sentences filled with double negations or very articulated. There are two main ways of parsing a sentence: Constituency and Dependency ...
1
vote
0answers
28 views

Fastest way to parse regex in R

I need to parse around 1.6k REGEX expressions such as the pair I am writing below. I have also around 7k documents (1/2 page long each in average) that need to be parsed according to the REGEX ...
0
votes
0answers
22 views

How to segregate resume layouts into different types?

I'm looking for any suggestions on how to segregate resume layout into different types. How do one proceed with such a task? I mean resumes are usually available as pdf or docx format and when we ...
1
vote
1answer
93 views
1
vote
1answer
52 views

Parsing and storing a large amount of HTML data

I have a data chunk (~30k) in which I have htmls pages and pngs saved in a folder for websites. These folders are titled based on some randomly generated hashes. My supervisor wants me to crunch ...
1
vote
0answers
185 views

simplifying AND OR Boolean Expression [closed]

My problem is turning a string that looks like this. "a OR (b AND c)" into a OR bc if the expression is like ...
0
votes
1answer
61 views

parsing a simple sentence using syntaxnet (on Ubuntu)

could someone help me in with the following. I would appreciate it. I would like to use syntaxnet to analyze a sentence. I installed Ubuntu on windows following ...
2
votes
1answer
217 views

parse pdf into Json or Xml [closed]

I want to create a neural net that can obtain some specific words from a pdf document into JSON or XML. For example let's assume that I have a pdf containing some information about countries and i ...
2
votes
3answers
890 views

What machine learning algorithms to use for unsupervised POS tagging?

I am interested in an unsupervised approach to training a POS-tagger. Labeling is very difficult and I would like to test a tagger for my specific domain (chats) where users typically write in lower ...
1
vote
0answers
123 views

Chunker/shallow parser for spoken language

I'm trying to extract NPs from transcribed spoken text, such as um it's the bl- it's the blue one in the right no left hand corner which contains e.g. fillers (e.g. um) and disfluencies (e.g. bl-,...
2
votes
1answer
650 views

Passing variables and values from an R script to a shell script

I'm working with a shell script(#!/bin/sh) and I wanted to know if there is a way to call variables with their values from an Rscript that I have called in my Shell script. If that doesn't make sense ...
0
votes
3answers
326 views

Learning token dictionary

When processing texts written in a human-readable language, typically a first step is tokenization, where we have a dictionary of tokens (words) and we collapse each substring in that dictionary into ...
1
vote
0answers
204 views

Generating a text training dataset from a grammar

I want to generate documents based on a grammar to build a custom training database. What are the tools and techniques to generate random texts based on a given grammar. More specifically, I would ...
4
votes
2answers
2k views

Information extraction with reinforcement learning, feasible?

I was wondering if one could use Reinforcement Learning (as it is going to be more and more trendy with the Google DeepMind & AlphaGo's stuff) to parse and extract information from text. For ...
2
votes
0answers
2k views

Decode SQLite database blobs: how to start?

Updated: see bottom of this question. Not sure if I am at the right channel here but I have good hopes someone here might be able to help me. I am trying to process and analyse data from a Footscan ...
8
votes
3answers
6k views

Is parsing files an application of machine learning?

I presently receive files from a device in a semi-csv format. I have a written a simple recursive descent parser for getting information out of these files. Every time the device updates firmware, I ...
4
votes
2answers
3k views

How to extract important phrases (which may contain company name) from resume?

I have thousands of CV / resumes with me. We want to build a parser which can extract company names from resume. So far we have tried Maintained a list of common words present in companies (Eg. Org,...
0
votes
1answer
60 views

Looking for a 'CITY, STATE' within a body of text (from a CITY-STATE database)

I'm looking for an optimal way to search a large body of text for a combination of words that resemble any CITY, STATE combination I have in a separate CITY-STATE database. My only idea would be to ...
1
vote
0answers
30 views

large database operation. check for relatedness between entities

I have one small list of entities, such as: Russia Vladimir Moscow Then I have a massive database of JSON indices. For each entry there are multiple alpha-...
1
vote
0answers
75 views

Correct tagging but wrong parse tree

If I parse following sentence: He is playing cricket in ground with grass. with stanford parser, the result is: ...
1
vote
0answers
318 views

parsing data by NLP using just offsets of words

E.g 1: "The speed of the car is 35 km/h and speed limit is 50 km/h" E.g 2: "The car is crossing the current speed limit by driving at 90 km/h". E.g.3: "Driving at 50 km/h your car will hit the ...
5
votes
1answer
2k views

semi-structured text parsing using machine learning

I am looking for a method to parse semi-structured textual data, i.e. data poorly formatted but usually having a visual structure of a matrix which may vary a lot in content and number of items in it, ...
2
votes
2answers
125 views

Parsing data from a string

I think this is something that experienced programmers do all the time. But, given my limited programming experience, please bear with me. I have an excel file which has particular cell entries that ...
13
votes
2answers
5k views

Sentiment data for Emoji

For experimenting we'd like to use the Emoji embedded in many Tweets as a ground truth/training data for simple quantitative senitment analysis. Tweets are usually too unstructured for NLP to work ...
1
vote
1answer
1k views

How to build parse tree with BNF [closed]

I need to build parse tree for some source code (on Python or any program language that describe by CFG). So, I have source code on some programming language and BNF this language. Can anybody give ...
3
votes
1answer
56 views

Can metadata be used to adapt parsing for an unescaped in field use of the delimiter?

I have data coming from a source system that is pipe delimited. Pipe was selected over comma since it was believed no pipes appeared in field, while it was known that commas do occur. After ingesting ...