Questions tagged [groupby]

A groupby operation: splits the data, applies a function to each group, and combines the results.

Filter by
Sorted by
Tagged with
-1 votes
0 answers
28 views

How to constrain a dataframe to specific date range?

I have a dataframe that I would like to chunck- or rather run temporal sentiment analysis at different times. I am trying to measure how sentiment changes as part of user identity in extremist social ...
user avatar
0 votes
1 answer
37 views

Using Pandas.groupby.agg with multiple columns and functions

I have a data frame which contains duplicates I'd like to combine based on 1 column (name). In half of the other columns I'd like to keep one value (as they should all be the same) whereas I'd like to ...
user avatar
  • 3
1 vote
1 answer
26 views

Grouping by Multi-Indices of both Row and Column [closed]

I have created a table using Pandas following material from here. The table created makes use of Multi-Indices for both columns and rows. I am trying to compute the descriptive statistics for each ...
user avatar
  • 11
0 votes
1 answer
22 views

Applied and view jobs ratio

I have the following data set where the column "kind" can be V(view) or A(apply), how can I do the following things given a particular job id how many applicant Apply (A) to that particular ...
user avatar
  • 105
0 votes
1 answer
39 views

How to find median/average values between data frames with slightly different columns?

I am trying to combat run-to-run variance of the data I collect by combining the data from different runs and finding the mean/average. The problem is that in each run there is a chance that some of ...
user avatar
0 votes
1 answer
23 views

panda grouping dates by variable with transposed value variables

I had read this post panda grouping by month with transpose and it gave me the nearest answer to my question but not the completely solution. How would I get somewhat like the reverse output? My ...
user avatar
  • 1
1 vote
1 answer
322 views

pandas groupby.count doesn't count zero occurrences

I am using groupby.count for 2 columns to get value occurrences under a class constraint. However, if value $x$ in feature never occurs with class $y$, then this pandas method returns only non-zero ...
user avatar
1 vote
0 answers
77 views

MongoDB Groupby Rank [closed]

Im Working With Mongodb And Wanted to do a query using Aggregate fucntion. Query Is ...
user avatar
  • 11
0 votes
1 answer
189 views

Using user defined function in groupby

I am trying to use the groupby functionality in order to do the following given this example dataframe: ...
user avatar
0 votes
0 answers
39 views

Accessing group elements in groupby

I had a doubt about groupby operations. Lets suppose I have grouped my data based on one column and got 5 groups as output. I know that we can iterate over these groups and apply functions to them as ...
user avatar
0 votes
1 answer
45 views

Access keys of pandas dataframe when using groupby

I have the following database: And I would like to know how many times a combination of BirthDate and Zipcode is repeated throughout the data table: Now, my question is: How can I access the keys of ...
user avatar
  • 113
-1 votes
3 answers
4k views

Pandas Groupby datetime by multiple hours [closed]

I have a log dataset which looks like the following:- ...
user avatar
0 votes
1 answer
734 views

Pandas - Avoid boolean result when using groupby()

I have this script: sectors = df.groupby(['company_sector']).mean()['investment_in_millions'] Output: I wanted to keep the same groupy() but having a result ...
user avatar
  • 99
1 vote
0 answers
25 views

Why is the behaviour of groupby command different in R and in python with pandas? [closed]

if I execute the following lines of codes in R as well as python for groupby command, the order of the resulting ...
user avatar
  • 135
4 votes
1 answer
18k views

How to use df.groupby() to select and sum specific columns w/o pandas trimming total number of columns

I got Column1, Column2, Column3, Column4, Column5, Column6 I'd like to group Column1 and get the row sum of Column3,4 and 5 When I apply groupby() and get this that is correct but it's leaving out ...
user avatar
  • 99
1 vote
1 answer
132 views

pandas groupby and sort values

I am studying for an exam and encountered this problem from past worksheets: This is the data frame called 'contest' with granularity as each submission of question from each contestant in the math ...
user avatar
  • 13
1 vote
1 answer
1k views

Pandas - Sum of multiple specific columns [closed]

I created this script: ...
user avatar
  • 99
3 votes
0 answers
24 views

User defined aggregations on data of around 200GB where row order matters

I am working with "medium large" data of around 200GB. The data are long form log files, where there are several thousand logs for each "entity". The entities are actually flights ...
user avatar
  • 226
1 vote
0 answers
35 views

Custom DataFrame format for exporting to excel sheets

I have the following DataFrame and I want it exported in an excel file with different sheets having different words as shown in the image ...
user avatar
  • 301
0 votes
2 answers
128 views

Calculating Median and Mode of numerical variables for different subgroups in R

I have customer call data and I want to get the median and mode for the call success rate for different subgroups. My variables are: Customer ID, Employment Status (Retired, Employed, Unemployed), ...
user avatar
  • 53
1 vote
1 answer
290 views

How to group by one column and count frequency from other column for each item in the previous column in python?

I am trying to group my data by the 'ID' column. Then I want to count the frequency of 'sequence' for each 'ID'. Here is a sample of the data frame: ...
user avatar
  • 21
0 votes
1 answer
318 views

How to combine rows after Pandas Groupby function

May I know how to combine several rows into one single row after I used Pandas groupby function? In below example, I would like to to group the data by Employee ID, Customer Last Name and Customer ...
user avatar
2 votes
1 answer
237 views

Normalize data from different groups

I have data that has been grouped into 27 groups by different criteria. The reason for these groupings is to show that each group has different behavior. However, I would like to normalize everything ...
user avatar
1 vote
1 answer
144 views

Group_by 2 variables and pivot_wider distribution based on 2 others

Performing some calculations on a dataframe and stuck trying to calculate a few percentages. Trying to append 3 additional columns added for %POS/NEG/NEU. E.g., the sum of amount col for all ...
user avatar
1 vote
0 answers
19 views

Pushing down Group By clause [closed]

I've studied this exercise in class But I cannot figure out why, when I push down the Group By clause, I can remove RLCode attribute from GroupBy. Does this action change the meaning of query tree?
user avatar
0 votes
1 answer
299 views

Problem with sort by and group by in pandas

I have a DataFrame with duplicate id's but have different dates. For Example: ...
user avatar
  • 1