File Operations in Python: Difference between revisions

From NovaOrdis Knowledge Base
Jump to navigation Jump to search
 
(9 intermediate revisions by the same user not shown)
Line 49: Line 49:
f.close()
f.close()
</syntaxhighlight>
</syntaxhighlight>
To read the content being written, before closing, you might need to <code>flush()</code>.


=Working Directory=
=Working Directory=
Line 84: Line 85:
==Path Operations with <tt>os.path</tt>==
==Path Operations with <tt>os.path</tt>==


To join two path fragments using the OS-native path separator:
To join two path fragments using the OS-native path separator use <code>os.path.join()</code>:


<syntaxhighlight lang='python'>
<syntaxhighlight lang='python'>
path1 = 'a'
path1 = 'a'
path2 = 'b'
path2 = 'b'
assert 'a/b' == os.path.join(path1, path2)
path3 = 'c'
assert 'a/b/c' == os.path.join(path1, path2, path3)
</syntaxhighlight>
</syntaxhighlight>


Line 108: Line 110:
{{Internal|Python_Module_shutil#Recursively_Copy_a_Directory|Recursively Copy a Directory with <tt>shutil</tt>}}
{{Internal|Python_Module_shutil#Recursively_Copy_a_Directory|Recursively Copy a Directory with <tt>shutil</tt>}}


=Temporary Files=
=<span id='Temporary_Files'></span>Temporary Files and Directories=
{{External|https://docs.python.org/3/library/tempfile.html}}
{{Internal|Python Temporary Files and Directories|Temporary Files and Directories}}
 
Create a named temporary file, write in it and return the name. The file is not automatically deleted after <code>close()</code>, the caller will need to delete it:
 
<syntaxhighlight lang='python'>
import tempfile
with tempfile.NamedTemporaryFile(mode='w+t', delete=False) as t:
  t.write(something)
  return t.name
</syntaxhighlight>


=<tt>pathlib</tt>=
=<tt>pathlib</tt>=
Line 143: Line 136:
<syntaxhighlight lang='python'>
<syntaxhighlight lang='python'>
Path('...').parent
Path('...').parent
</syntaxhighlight>
====Accessing the Full Path====
<syntaxhighlight lang='python'>
str(Path('...'))
</syntaxhighlight>
</syntaxhighlight>


Line 177: Line 174:
</syntaxhighlight>
</syntaxhighlight>
The directory must be empty. <code>shutil</code> has a function that [[Python_Module_shutil#Recursively_Delete_a_Directory|deletes the directory recursively]].
The directory must be empty. <code>shutil</code> has a function that [[Python_Module_shutil#Recursively_Delete_a_Directory|deletes the directory recursively]].
====Remove a file or a symbolic link====
<syntaxhighlight lang='python'>
from pathlib import Path
path = Path(path_to_file)
path.unlink()
</syntaxhighlight>
By default, the call will raise a <code>FileNotFoundError</code> if the file does not exist. To mute this behavior, use <code>unlink(missing_ok=True)</code>.


====<tt>iterdir()</tt>====
====<tt>iterdir()</tt>====
Iterate over the files in this directory.  Does not yield any result for the special paths '.' and '..'.
Iterate over the files and directories in the given directory.  Does not yield any result for the special paths '.' and '..'.
<syntaxhighlight lang='python'>
<syntaxhighlight lang='python'>
from pathlib import Path
from pathlib import Path
path = Path(path_to_dir)
path = Path(path_to_dir)
for f in path.iterdir():
for f in path.iterdir():
   ...
   if f.is_file():
    ...
  elif f.is_dir():
    ...
</syntaxhighlight>
</syntaxhighlight>
====<tt>touch()</tt>====
Creates the file.


===Other <tt>pathlib</tt> Methods===
===Other <tt>pathlib</tt> Methods===

Latest revision as of 18:50, 21 June 2023

Internal

TODO

  • TO PROCESS PyOOP "File I/O" + "Placing it in context"
  • TO PROCESS PyOOP "Filesystem paths"

Check whether a File Exists

Use either or pathlib exists(), is_file(), is_dir() or os.path.exists().

Reading/Writing from/to Files

The open() Built-in

open() is a built-in function.

Read

Understand this idiom. What does with do? Does it automatically close the file when it exits the block? Apparently this is a "context manager".

with open('somefile.txt', 'rt') as f:
  text = f.read()
  print(text)

 f = open(''filename'', ''mode'')
 c = f.read()
 f.close()
f = open('somefile', 'rt')
c = f.read()
f.close()

Mode: "r", "w", "x", etc. "t" text, "b" binary

Write

f = open('/Users/ovidiu/tmp/out.json', 'wt')
f.write("test\n")
f.close()

To read the content being written, before closing, you might need to flush().

Working Directory

import os
print('getcwd:', os.getcwd())

Also see:

os

The Path of the Running Script File

print('__file__:', __file__)

Paths

os.path.basename returns the file name from the file path:

import os
print(os.path.basename(__file__))

os.path.dirname returns the directory name from the file path.

import os
print(os.path.dirname(__file__))

os.path.abspath return the absolute path from a file path.

os.path.splittext returns the file name from the file path.

Use the pathlib module to extract directory name.

Path Operations with os.path

To join two path fragments using the OS-native path separator use os.path.join():

path1 = 'a'
path2 = 'b'
path3 = 'c'
assert 'a/b/c' == os.path.join(path1, path2, path3)

Removing Files

import os
os.remove("somefile.txt")
os.rmdir("somedir") # removes an empty directory
shutil.rmtree() # deletes a directory and all its contents.

Path objects from the Python 3.4+ pathlib module also expose these instance methods:

pathlib.Path.unlink()  # removes a file or symbolic link.
pathlib.Path.rmdir() # removes an empty directory.

Recursively Copy a Directory

Recursively Copy a Directory with shutil

Temporary Files and Directories

Temporary Files and Directories

pathlib

Path represents a filesystem path that offers methods to do system calls on path objects. Depending on your system, instantiating a Path will return either a PosixPath or a WindowsPath object. You can also instantiate a PosixPath or WindowsPath directly, but cannot instantiate a WindowsPath on a POSIX system or vice versa.

New Path instance can be constructed from a Path instance:

path = Path('.')
path2 = Path(path, './some-file.txt')

Convert the Path to a string with str():

path = Path('.')
print(str(path))

Accessing the File Name

Path('...').name

Accessing the Parent

Path('...').parent

Accessing the Full Path

str(Path('...'))

resolve(strict=False)

Relative paths ("../../..") can be "resolved" with:

path = Path('/Users/ovidiu/..')
print(path.resolve()) # will display "/Users"

mkdir(mode=0o777, parents=False, exist_ok=False)

Create a directory, including its non-existent parents if required.

d = Path('somedir')
d.mkdir(0o700, True, False)

Setting parents to True will create intermediate missing directories if necessary. By default, parents is False.

The method fails if the directory already exists, unless exist_ok is set to True.

exists(), is_file(), is_dir()

from pathlib import Path
path = Path(path_to_file)
path.exists()
path.is_file()
path.is_dir()

rmdir()

from pathlib import Path
path = Path(path_to_dir)
path.rmdir()

The directory must be empty. shutil has a function that deletes the directory recursively.

Remove a file or a symbolic link

from pathlib import Path
path = Path(path_to_file)
path.unlink()

By default, the call will raise a FileNotFoundError if the file does not exist. To mute this behavior, use unlink(missing_ok=True).

iterdir()

Iterate over the files and directories in the given directory. Does not yield any result for the special paths '.' and '..'.

from pathlib import Path
path = Path(path_to_dir)
for f in path.iterdir():
  if f.is_file():
     ...
  elif f.is_dir():
     ...

touch()

Creates the file.

Other pathlib Methods

  • cwd()
  • home()
  • samefile(other_path)
  • glob(pattern)
  • rglob(pattern)
  • absolute()
  • stat()
  • group()
  • open(mode='r', buffering=-1, encoding=None, errors=None, newline=None)
  • read_bytes()
  • read_text(encoding=None, errors=None)
  • write_bytes(data)
  • write_text(data, encoding=None, errors=None)
  • touch(mode=0o666, exist_ok=True)
  • chmod(mode)
  • lchmod(mode)
  • unlink(missing_ok=False)
  • lstat()
  • link_to(target)
  • rename(target)
  • replace(target)
  • symlink_to(target, target_is_directory=False)
  • is_mount()
  • is_symlink()
  • is_block_device()
  • is_char_device()
  • is_fifo()
  • is_socket()
  • expanduser()

os.path

exists(path_to_file)

import os.path
file_exists = os.path.exists(path_to_file)

Returns True or False.