Extract rows based on the particular value from a particular column and export it to new csv file

Question

CSV file as stack.csv

PROBLEM_CODE;OWNER_EMAIL;CALENDAR_YEAR;CALENDAR_QUARTER
CONFIG_ASSISTANCE;[email protected];2014;2014Q3
ERROR_MESSAGES;[email protected];2014;2014Q3
PASSWORD_RECOV;[email protected];2014;2014Q3
ERROR_MESSAGES;[email protected];2014;2014Q3
ERROR_MESSAGES;[email protected];2014;2014Q3
SOFTWARE_FAILURE;[email protected];2014;2014Q3
ERROR_MESSAGES;[email protected];2014;2014Q3
SOFTWARE_FAILURE;[email protected];2014;2014Q3

My Code:

import pandas as pd 
import csv
data = pd.read_csv('stack.csv', sep='delimiter')
min_indices = (data['OWNER_EMAIL'] == [email protected])
data = data[min_indices]
data.to_csv('isabevdata.csv')

Error:

KeyError: 'OWNER_EMAIL'

I need help with this code using pandas. I want to remove some columns later on from the result: isabevdata.csv --> using petl module and then send the table to front end for display

I am still getting error as :: "UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe1 in position 14: invalid continuation byte" . — deepman harshwardhan, Oct 01 '16 at 14:18
The actual csv file on which i am working is having 28k rows and 30 columns. When I am using small csv file as one mentioned above i get no error . but when I am trying to work with big amount of data, i get this error — deepman harshwardhan, Oct 01 '16 at 14:20
you need to wrap `[email protected]` in quotes `'[email protected]'` as well as `sep=';'` — piRSquared, Oct 01 '16 at 14:22
Thanks MaxU and piRSquared, it works well with test data , but like I said with a big chunk of data , i get below error :: — deepman harshwardhan, Oct 01 '16 at 14:28
File "pandas\parser.pyx", line 1402, in pandas.parser._string_box_utf8 (pandas\parser.c:19247) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe1 in position 14: invalid continuation byte — deepman harshwardhan, Oct 01 '16 at 14:30
@deepmanharshwardhan can you show us what line 1402 looks like? — piRSquared, Oct 01 '16 at 14:37
in the above shared line , ";;" , I have verified that they are blank cells and at the end ";;" is same for every row. — deepman harshwardhan, Oct 01 '16 at 14:53
There are characters that are not unicode encoded. Either get the unicode encoded csv from the source and work on it or read the file as a normal binary file do something like this http://stackoverflow.com/a/5552623/2650427 or this http://stackoverflow.com/a/5552616/2650427 and then feed that data to pandas. Before going that way you can also try ```encoding="lain-1"``` — TrigonaMinima, Oct 01 '16 at 18:02

Extract rows based on the particular value from a particular column and export it to new csv file

0 Answers0