When a folder hierarchy is shared between multiple people or departments (such as a shared file server), things often get messy because everyone thinks about organizing and finding files in different ways. This article takes an in-depth look at why folder hierarchies are important and provides best practices for folder organization. If you don’t have the bandwidth at the moment to read an entire article, my earlier Tips for Setting Up An Organized Folder Structure provides a short list of ideas to get you quickly started.
Do I Really Need a Folder Hierarchy?
Similar to the reasons mentioned in the Filenaming Best Practices article, you could store all of your files in one folder and then use a digital asset management system to find everything by keywords or other metadata. Here’s some reasons why this usually isn’t a good approach.
Access Outside of the DAM
A well-structured folder hierarchy makes it easy for anyone to find what they’re looking for, especially when they’re not using a DAM. Many DAM systems use an open file repository that can be accessed like a normal folder. Administrators can provide basic access so authorized users just go to a regular old folder to find what they need or add files – no special software or training required.
Organization
Folders provide another level of organization in addition to keywords, taxonomies, folksonomies, categories and other ways of grouping files in within a DAM. Need to quickly group several files together? Put them in a folder! The folder will group the items within the DAM as well as for any other external users.
Automatic Cataloging
Many DAM systems have features for automatically cataloging one or more specified “hot folders”. Need to catalog a file so that it’s available in the DAM? Just place it into the appropriate folder.
An Absolute Location
While keywords and other metadata within a DAM can change, the path to a file is absolute. If you place a file within a folder, it will still be there when you look for it later (unless someone with the right file permissions moves it). Search results can change as options and information within the DAM change, but the folder the file is stored within will always be the “truth” – a place where you know you can find the file.
Performance
A Windows file server can theoretically hold 4,294,967,295 files in one folder, and a folder on a Mac file server can theoretically hold 2,147,483,648. However, you would have a difficult time viewing that folder as your file manager (Explorer on Windows, Finder on Mac) choked on the contents trying to display the mile long list of filenames, dates and thumbnails. Even in the tens of thousands of items range, performance can suffer when too many files are stuffed into one folder. Storing files in a multiple folders can improve performance both inside and out of your DAM.
Best Practices
Below is a list of folder organization best practices that has been expanded from the original article, 5 Tips for Setting up an Organized Folder Structure.
Create a Folder Template
Create an empty group of folders and subfolders as a template if the same subfolders will be used throughout the folder structure, or if you anticipate creating folders in the future that need a common group of subfolders. This will allow you to quickly copy and paste the template of subfolders into new folders instead of manually creating each subfolder. For example, every folder created inside the “Projects” folder could use a template of “Artwork”, “Layout”, “Fonts” and “Text” subfolders.
Determine Folder Direction
Do you create a “2012” folder inside of the “Events” folder, or create an “Events” folder inside of the “2012” folder? The answer to this question usually depends on how people will browse your folder structure and how often new folders will need to be created.
Determine Level of Granularity
It may be unrealistic to create every single folder that will ever be needed up front, so there will usually be a level at which users can create their own subfolders. A good approach is to determine the first two, three or four levels in the hierarchy and then let users create subfolders for the lower levels. For example, you could have a folder called “Projects” where users would could create subfolders as needed.
Don’t “Float” Folders
Placing a space, underscore, or other special characters at the beginning of a folder name will force the folder to “float” to the top of alphabetically sorted lists. However this trick can lead to problems since the folder does not appear in its usual place. For example, someone browsing for the “Projects” folder may miss the “_Projects” folder at the top of the list expecting to see it between the “Marketing” and “Research” folders, and end up creating a duplicate “Projects” folder without the underscore in front.
Don’t Use Mac-specific Options
The Mac OS Finder lets OS X users do cool things like apply color labels to folders and apply custom icons to folders instead of using the generic folder icon. People may become accustomed to seeing this on the Mac, or rely on it assuming that windows users can see it too. Also keep in mind that the following characters are allowed on Mac, but not on Windows: \ / : * ? “ < > | [ ] & $
Use Folder Names to Apply Keywords
Some DAM systems and search tools will generate keywords based on the folders where files are stored. When setting up your folder structure think about keywords that would be applied based on folder names. For example, a file in a folder called “Holiday Party” inside the “Events” folder will appear in search results for “holiday”, “party”, or “events”.
Avoid Redundancy Traps
Try not to create folders with overlapping categories. If you have a top level folder called “Pictures” and another top level folder called “People” you probably don’t want to copy a picture of a person into both folders. Instead eliminate one folder or the other, or place one folder inside of the other. For example, the “Pictures” folder could go inside the “People” folder.
Create a Cheat Sheet
Document your folder hierarchy rules and conventions. You don’t need to create anything complex, just a listing of what goes at each level of the hierarchy along with a list of “DOs” and “DON’Ts” based on these best practices.
Consider Starting Over
Start fresh with a new, clean, and well planned folder structure if your existing folder structure is too disorganized. This can be done by moving existing items into the correct place within the new structure, or by choosing a cutoff date at which point the old location becomes a read-only archive where any changes must be copied to the new location.
Summary
These best practices can apply to anyone, but the real power is combining the above tips with a digital asset management system to get the best of both words – browsing and searching. There may be exceptions to these recommendations based on your workflow, so don’t be afraid to stray from these points and do what works best.
How do you organize your folders and subfolders? Do any of your folder structures intentionally or unintentionally stray from the above guidelines? Share your folder structure examples and tips in the comments section below.
Great list here, very helpful for video production studios.
You say “Some DAM systems and search tools will generate keywords based on the folders where files are stored.”
I’m trying to do exactly that so each of my files gets tagged with all of its parent folders. Do you have any suggestions of ways to accomplish that?
thanks.
What software are you using to manage your files?
This is my first attempt at DAM. Right now I’m attempting to use Extensis Portfolio Server. The desktop application is “unable to connect,” so I’m trying to work that out now.
Ideally I just need a simple standalone application that adds metadata based on parent folders.
Not interested in using the a client to view or find my files, only to add metadata so things are searchable in my editing program.
You can contact Extensis support online http://www.extensis.com/en/support/contact_prod_support.jsp or by calling (503) 274-7030 for assistance with the desktop application.
In the Desktop application choose Catalog > Advanced Options > Properties and make sure that “Keywords from Path” is enabled with “Path Name” selected. Any files cataloged after that is enabled will automatically have keywords generated based on file and folder names. If you want those keywords to show in other applications, you will want to select one or more files and choose “Item > Embed Properties” to write those keywords into the file as metadata.
Thanks so much Edward, this will really help me out.
Thanks much for your thoughts on folder hierarchy considerations.
Considering that I have four data sources at the moment (iphone, ipad, Sony NEX-7, Sony Alpha A65) I am using a system right now that employs the following concepts.
1. Camera to external HDD labelled with the following structure:
/CAMERA_ORIG/2012/_new
After copying all my latest data to this location, I then immediately batch file rename all the media to:
YYYY-MM-DD-HHMM
using A Better File Renamer (OS-X)
In the case of multiple sequential shots (i.e., 10fps) they will be automatically and uniquely identified as:
HHMMa, HHMMb, HHMMc, etc.
After renaming, and this is where I get confused, I resort this newest data via drag-and-drop into subfolders one for each month:
/CAMERA_ORIG/2012/01
/CAMERA_ORIG/2012/02
/CAMERA_ORIG/2012/03…. etc….. 12
However, I am beginning to rethink that having a /year/month/ categorization system and then organizing the data with unique file names YYYY-MM-DD-HHMM tells me even less. So, what I am thinking to do is to do away with the monthly (01, 02, 03 subfolders) and under each year create a template folder/subfolder structure somewhat as follows:
/2012/ETC
/2012/ETC-v
/2012/EVENT
/2012/EVENT-v
/2012/PEOPLE
/2012/PEOPLE-v
/2012/PLACE
/2012/PLACE-v
/2012/YESTERYEAR
/2012/YESTERYEAR-v
Each year would have this generic set of subfolders in lieu of 01,02, 03 as monthly subfolders. Most things can be categorized under PEOPLE, PLACES, EVENTS. YESTERYEAR exists for items I have scanned like childhood photos and/or pictures I took before the digital revolution. The ETC folder is a catch all for any thing that would be not categorizable under the basic three. (i.e., items I sell on auction, photos of receipts, business cards, etc. I am thinking to further add subfolders in this template under ETC to accommodate data most likely I will accumulate annually:
/ETC/auction
/ETC/nature
/ETC/clipart
/ETC/product
The -v in each category would be to break out the media type as video content versus image content.
This system is still not infallible, but, I am trying to grapple with the problem and not go bananas in the process. This structure is done all outside of any DAM software. I currently use Lightroom 4 but until now, only for basic edititng routines (i.e., cropping, exposure adjustments, etc.). But I see now that they have an organizational system within that application called Collections.
I appreciate any thoughts, recommendations you might have to offer to alter the way I have been doing things. Thanks.
Would LOVE a suggestion for moving from years of Windows/My Pictures/131012 (current date) filing folders of photos into something more effective, any suggestions? Goal is to be able to upload files to the web more effectively, the current filing process and maneuvering between Windows Explorer and IE is time click consuming and messy. TIA!
It might be time to consider using another piece of software in addition to your folder structure. A DAM or even desktop cataloger will offer a way to “virtually” organize assets into galleries, tags, keywords, etc making it easier to group items for upload.
The software should also be capable of searching and viewing when the photos were taken (using EXIF metadata stored by the camera), eliminating the need to create folders based on date. Also, the software could be used to convert files to the proper format before upload (for example, convert camera raw into screen resolution JPEGs).