I need a way to change the specific value of a column of a CSV file. For example I have this CSV file:
"Ip","Sites" "127.0.0.1",10 "127.0.0.2",23 "127.0.0.3",50
and I need to change the value 23 to 30 of the row “127.0.0.2”.
I use csv library: import csv
Answers:
Thank you for visiting the Q&A section on Magenaut. Please note that all the answers may not help you solve the issue immediately. So please treat them as advisements. If you found the post helpful (or not), leave a comment & I’ll get back to you as soon as possible.
Method 1
This is the solution opening the csv file, changing the values in memory and then writing back the changes to disk.
r = csv.reader(open('/tmp/test.csv')) # Here your csv file
lines = list(r)
Content of lines:
[['Ip', 'Sites'], ['127.0.0.1', '10'], ['127.0.0.2', '23'], ['127.0.0.3', '50']]
Modifying the values:
lines[2][1] = '30'
Content of lines:
[['Ip', 'Sites'], ['127.0.0.1', '10'], ['127.0.0.2', '30'], ['127.0.0.3', '50']]
Now we only have to write it back to a file
writer = csv.writer(open('/tmp/output.csv', 'w'))
writer.writerows(lines)
Method 2
You can use very powerful library called pandas. Here is the example.
import pandas as pd
df = pd.read_csv("test.csv")
df.head(3) #prints 3 heading rows
Output:
Ip Sites 0 127.0.0.1 10 1 127.0.0.2 23 2 127.0.0.3 50
Now if you want to change the value in the ‘Sites’ column in the 1st row, run:
df.set_value(1, "Sites", 30)
If you want to change all the values, where ‘Ip’ is equal to 127.0.0.2, run:
df.loc[df["Ip"]=="127.0.0.2", "Sites"] = 30
Finally, to save the values:
df.to_csv("test.csv", index=False)
Method 3
You can’t really replace values in the existing file. Instead, you need to:
- read in existing file
- alter file in memory
- write out new file (overwriting existing file)
What you can also do is read in the existing file line by line, writing it out to a new file, while replacing values on the fly. When done, close both files, delete the original and rename the new file.
Method 4
An alternative to the accepted answer is to:
- Use
fileinputwithinplace=Trueto modify the file in-place - Use
csv.DictReaderto access the column via header instead of indices (This only works if the CSV has headers)
Test CSV:
Ip,Sites
127.0.0.1,10
127.0.0.2,23
127.0.0.3,50
Test Code:
import fileinput
with fileinput.input(files=('test.csv'), inplace=True, mode='r') as f:
reader = csv.DictReader(f)
print(",".join(reader.fieldnames)) # print back the headers
for row in reader:
if row["Ip"] == "127.0.0.2":
row["Sites"] = "30"
print(",".join(<div class="su-row"></div>, row["Sites"]]))
The main difference is that you don’t have to manually open the input file and create the output file, as inplace=True already does that behind-the-scenes:
Optional in-place filtering: if the keyword argument
inplace=Trueis
passed tofileinput.input()or to theFileInputconstructor, the file
is moved to a backup file and standard output is directed to the input
file (if a file of the same name as the backup file already exists, it
will be replaced silently). This makes it possible to write a filter
that rewrites its input file in place.
The loop goes over the CSV row-by-row (except for the header row), so you can do whatever processing you need on each row.
If you still want to retain the original, you could pass in a backup=".backup" so that fileinput creates a test.csv.backup file.
Also, note that with in-place editing, “standard output is directed to the input file“, so print(..) prints it out to the file instead of to the command line. If you want to actually print to the console, you need to specify stderr as in print(..., file=sys.stderr).
All methods was sourced from stackoverflow.com or stackexchange.com, is licensed under cc by-sa 2.5, cc by-sa 3.0 and cc by-sa 4.0