Python file list by date

geekdudes

Python – Listing files in directory and sub-directories,sort files by creation date and select top X files

from itertools import islice def getListOfFiles(dirName): # create a list of file and sub directories # names in the given directory listOfFile = os.listdir(dirName) allFiles = list() # Iterate over all the entries for entry in listOfFile: # Create full path fullPath = os.path.join(dirName, entry) # If entry is a directory then get the list of files in this directory if os.path.isdir(fullPath): allFiles = allFiles + getListOfFiles(fullPath) else: allFiles.append(fullPath) return allFiles dirName = "C:\SIEMLogs\Email" listOfFiles = getListOfFiles(dirName) # sort filenames by creation date (ascending) sorted_files = sorted(listOfFiles, key=os.path.getmtime) # select top 5 elements from sorted list top_files = islice(sorted_files,5) # Print top 5 files for elem in top_files: print(elem) # Number of files in sub directories cpt = sum([len(files) for r, d, files in os.walk("C:\SIEMLogs\Email")]) print cpt

Listing files in directory (without sub directories),sorting by creation date (ascending) and count of total files:

path = "C:\SIEMLogs\Email" name_list = os.listdir(path) full_list = [os.path.join(path,i) for i in name_list] time_sorted_list = sorted(full_list, key=os.path.getmtime) for a in time_sorted_list: print a # Number of files in Directory only path, dirs, files = next(os.walk("C:\SIEMLogs\Email")) file_count = len(files) print file_count

Источник

Python: Get list of files in directory sorted by date and time

In this article, we will discuss different ways to get list of all files in a directory / folder sorted by date and time in python.

Table of contents

Get list of files in directory sorted by date using glob()

In python, the glob module provides a function glob() to find files in a directory based on matching pattern. Similar to the unix path expansion rules, we can use wildcards and regular expression to match & find few or all files/sub-directories in a directory. We will use this to get a list of all files in a directory but sorted by the last modification time. Steps are as follows,

1. Get a list of all files & directories in the given directory using glob().
2. Using the filter() function and os.path.isfileIO(), select files only from the list.
3. Sort the list of files based on last modification time using sorted() function.
   • For this, use os.path.getmtime() as the key argument in the sorted() function.

Complete example to get a list of all files in directory sorted by last modification datetime is as follows,

import glob import os import time dir_name = 'C:/Program Files/Java/jdk1.8.0_191/' # Get list of all files only in the given directory list_of_files = filter( os.path.isfile, glob.glob(dir_name + '*') ) # Sort list of files based on last modification time in ascending order list_of_files = sorted( list_of_files, key = os.path.getmtime) # Iterate over sorted list of files and print file path # along with last modification time of file for file_path in list_of_files: timestamp_str = time.strftime( '%m/%d/%Y :: %H:%M:%S', time.gmtime(os.path.getmtime(file_path))) print(timestamp_str, ' -->', file_path)

Frequently Asked:

10/06/2018 :: 04:34:06 --> C:/Program Files/Java/jdk1.8.0_191\COPYRIGHT 10/06/2018 :: 04:34:08 --> C:/Program Files/Java/jdk1.8.0_191\src.zip 11/18/2018 :: 09:42:11 --> C:/Program Files/Java/jdk1.8.0_191\LICENSE 11/18/2018 :: 09:42:11 --> C:/Program Files/Java/jdk1.8.0_191\README.html 11/18/2018 :: 09:42:11 --> C:/Program Files/Java/jdk1.8.0_191\THIRDPARTYLICENSEREADME-JAVAFX.txt 11/18/2018 :: 09:42:11 --> C:/Program Files/Java/jdk1.8.0_191\THIRDPARTYLICENSEREADME.txt 11/18/2018 :: 09:42:12 --> C:/Program Files/Java/jdk1.8.0_191\javafx-src.zip 11/18/2018 :: 09:42:19 --> C:/Program Files/Java/jdk1.8.0_191\release

In this solution we created a list of files in a folder, sorted by date. But the list contains the complete path of the files. What if we want only file names in sorted order by date and time?

Get list of files in directory sorted by date using os.listdir()

In Python, the os module provides a function listdir(dir_path), which returns a list of file & directory names in the given directory path. Using the filter() function and os.path.isfileIO(), select files only from the list. Then we can sort this list of file names based on the last modification time, using the os.path.getmtime() function as the key argument in the sorted() function.

Complete example to get list of files in directory sorted by last modification datetime is as follows,

import os import time dir_name = 'C:/Program Files/Java/jdk1.8.0_191/' # Get list of all files only in the given directory list_of_files = filter( lambda x: os.path.isfile(os.path.join(dir_name, x)), os.listdir(dir_name) ) # Sort list of files based on last modification time in ascending order list_of_files = sorted( list_of_files, key = lambda x: os.path.getmtime(os.path.join(dir_name, x)) ) # Iterate over sorted list of files and print file path # along with last modification time of file for file_name in list_of_files: file_path = os.path.join(dir_name, file_name) timestamp_str = time.strftime( '%m/%d/%Y :: %H:%M:%S', time.gmtime(os.path.getmtime(file_path))) print(timestamp_str, ' -->', file_name)

10/06/2018 :: 04:34:06 --> COPYRIGHT 10/06/2018 :: 04:34:08 --> src.zip 11/18/2018 :: 09:42:11 --> LICENSE 11/18/2018 :: 09:42:11 --> README.html 11/18/2018 :: 09:42:11 --> THIRDPARTYLICENSEREADME-JAVAFX.txt 11/18/2018 :: 09:42:11 --> THIRDPARTYLICENSEREADME.txt 11/18/2018 :: 09:42:12 --> javafx-src.zip 11/18/2018 :: 09:42:19 --> release

In this solution we created a list of file names in a folder sorted by date. The sorted() function uses the key argument as the comparator while sorting the items in given list. Therefore, by passing os.path.getmtime() as the key argument, we forced it to sort the files by last modification time,

Python: Get list of files in directory and sub-directories sorted by date

In both the previous examples we created a list of files in a directory sorted by date. But it covered the files in the given directory only, not in nested directories. So, if you want to get a list of files in directory and sub-directory sorted by date then checkout this example,

import glob import os import time dir_name = 'C:/Program Files/Java/jdk1.8.0_191/' # Get list of all files only in the given directory list_of_files = filter( os.path.isfile, glob.glob(dir_name + '/**/*') ) # Sort list of files based on last modification time in ascending order list_of_files = sorted( list_of_files, key = os.path.getmtime) # Iterate over sorted list of files and print file path # along with last modification date time for file_path in list_of_files: timestamp_str = time.strftime( '%m/%d/%Y :: %H:%M:%S', time.gmtime(os.path.getmtime(file_path))) print(timestamp_str, ' -->', file_path)

11/18/2018 :: 09:42:11 --> C:/Program Files/Java/jdk1.8.0_191\bin\appletviewer.exe 11/18/2018 :: 09:42:11 --> C:/Program Files/Java/jdk1.8.0_191\bin\extcheck.exe 11/18/2018 :: 09:42:11 --> C:/Program Files/Java/jdk1.8.0_191\bin\idlj.exe 11/18/2018 :: 09:42:11 --> C:/Program Files/Java/jdk1.8.0_191\include\jdwpTransport.h 11/18/2018 :: 09:42:11 --> C:/Program Files/Java/jdk1.8.0_191\include\jni.h 11/18/2018 :: 09:42:11 --> C:/Program Files/Java/jdk1.8.0_191\include\jvmti.h 11/18/2018 :: 09:42:11 --> C:/Program Files/Java/jdk1.8.0_191\include\jvmticmlr.h 11/18/2018 :: 09:42:13 --> C:/Program Files/Java/jdk1.8.0_191\jre\COPYRIGHT 11/18/2018 :: 09:42:13 --> C:/Program Files/Java/jdk1.8.0_191\jre\Welcome.html 11/18/2018 :: 09:42:13 --> C:/Program Files/Java/jdk1.8.0_191\lib\ant-javafx.jar 11/18/2018 :: 09:42:14 --> C:/Program Files/Java/jdk1.8.0_191\lib\ct.sym 11/18/2018 :: 09:42:14 --> C:/Program Files/Java/jdk1.8.0_191\lib\dt.jar 11/18/2018 :: 09:42:14 --> C:/Program Files/Java/jdk1.8.0_191\lib\jvm.lib 11/18/2018 :: 09:42:17 --> C:/Program Files/Java/jdk1.8.0_191\lib\orb.idl 11/18/2018 :: 09:42:17 --> C:/Program Files/Java/jdk1.8.0_191\lib\packager.jar 11/18/2018 :: 09:42:17 --> C:/Program Files/Java/jdk1.8.0_191\lib\sa-jdi.jar 11/18/2018 :: 09:42:26 --> C:/Program Files/Java/jdk1.8.0_191\lib\tools.jar 11/18/2018 :: 09:42:26 --> C:/Program Files/Java/jdk1.8.0_191\jre\lib\plugin.jar 11/18/2018 :: 09:42:27 --> C:/Program Files/Java/jdk1.8.0_191\jre\lib\javaws.jar 11/18/2018 :: 09:42:27 --> C:/Program Files/Java/jdk1.8.0_191\jre\lib\deploy.jar 11/18/2018 :: 09:42:31 --> C:/Program Files/Java/jdk1.8.0_191\jre\lib\rt.jar 11/18/2018 :: 09:42:32 --> C:/Program Files/Java/jdk1.8.0_191\jre\lib\jsse.jar 11/18/2018 :: 09:42:32 --> C:/Program Files/Java/jdk1.8.0_191\jre\lib\charsets.jar 11/18/2018 :: 09:42:32 --> C:/Program Files/Java/jdk1.8.0_191\jre\lib\ext\localedata.jar 11/18/2018 :: 09:42:34 --> C:/Program Files/Java/jdk1.8.0_191\jre\bin\server\classes.jsa

We used the glob() function with pattern ‘/**/*’ and recursive=True argument. It gave a list of all files in the given directory and all sub-directories. Then using the os.path.getmtime() function as the key argument in sorted() function, we created a list of files sorted by date and time.

We learned about different ways to get a list of files in a folder, sorted by date & time.

Related posts:

Источник

Sort Files by Date in Python

To sort files by date using Python, you can use the os module listdir() function to get all files in a directory. Then use the
os.path.getcttime() or os.path.getmttime() to get the file creation or modification dates, respectively, inside a sort function.

import os files = os.listdir() print(files) files.sort(key=lambda x: os.path.getmtime(x)) #Sort by Modification Time print(files) #Output ['code1.txt', 'code2.txt', 'code3.txt'] ['code1.txt', 'code3.txt', 'code2.txt']

When working with files in Python, the ability to get a list of files in a directory and sort by date can be useful.

With the help of the Python os module, we can easily get a list of files and sort them by either creation date or modification date.

The Python os module has many great functions which help us interact with the operating system of our computer.

Let’s say we have the following directory with three files.

To get the files in this directory, we first use the os module listdir() function. Then, we have two options for sorting; we can sort by file modification date or by file creation date.

How to Sort Files by File Modification Date with Python

If you want to sort files by file modification date, the easiest way is to sort using a lambda function and use the os.path.os.path.getmtime() function.

Below shows you how you would sort files by modification date in Python for our example directory.

import os files = os.listdir() print(files) files.sort(key=lambda x: os.path.getmtime(x)) #Sort by Modification Time print(files) #Output ['code1.txt', 'code2.txt', 'code3.txt'] ['code1.txt', 'code3.txt', 'code2.txt']

How to Sort Files by File Creation Date with Python

If you want to sort files by file creation date, the easiest way is to sort using a lambda function and use the os.path.os.path.getctime() function.

Below shows you how you would sort files by creation date in Python for our example directory.

import os files = os.listdir() print(files) files.sort(key=lambda x: os.path.getctime(x)) #Sort by Creation Time print(files) #Output ['code1.txt', 'code2.txt', 'code3.txt'] ['code1.txt', 'code2.txt', 'code3.txt']

Hopefully this article has been useful for you to learn how to sort files by date in Python.

Other Articles You’ll Also Like:

• 1. pandas Standard Deviation – Using std() to Find Standard Deviation
• 2. Using Python to Find Second Largest Value in List
• 3. Convert First Letter of String to Lowercase in Python
• 4. How to Remove All Occurrences of a Character in a List Using Python
• 5. Remove Empty Lists from List in Python
• 6. Using Python to Calculate Average of List of Numbers
• 7. How to Write Python Dictionary to File
• 8. Get Day of the Year with Python
• 9. Python Random Uniform – Generate Random Numbers Uniformly in Range
• 10. How to Read Pickle File from AWS S3 Bucket Using Python

About The Programming Expert

The Programming Expert is a compilation of a programmer’s findings in the world of software development, website creation, and automation of processes.

Programming allows us to create amazing applications which make our work more efficient, repeatable and accurate.

At the end of the day, we want to be able to just push a button and let the code do it’s magic.

You can read more about us on our about page.

Источник