They once helped millions of people navigate the internet. Then search engines made them seem unnecessary. But as the web grows more complicated, perhaps directories still have something valuable to offer.

Imagine opening your browser without knowing exactly what you're looking for.

You have a vague interest in photography, independent technology projects or unusual educational resources. You want to find something worthwhile, but you don't have a particular website in mind.

What do you do?

Most of us would open a search engine, enter a few words and browse the results.

It's a perfectly reasonable approach. Search engines have become remarkably effective at helping us locate information.

But searching and exploring aren't quite the same thing.

When you search, you usually have a question.

When you explore, you're looking for possibilities.

And for much of the internet's history, there was another way to discover what existed online.

It was called the website directory.

Today, directories are often dismissed as relics of an earlier web, associated with outdated pages, abandoned links and questionable SEO practices.

Some deserve that reputation.

Others suggest that the idea itself may still be useful.

So here's an interesting question: could website directories make a comeback, not as replacements for search engines, but as a different way to experience the internet?

Before Search Engines Became Our Maps

The early internet presented a peculiar challenge.

People were creating websites, but finding them wasn't always straightforward.

Search technology existed, yet the tools available to everyday users were far less sophisticated than today's search engines.

One solution was surprisingly human: organise websites into categories.

Instead of asking a search engine to find a particular page, visitors could navigate through collections of websites grouped by subject.

Technology. Arts. Education. Science. Business. Recreation.

A category might contain subcategories, which led to increasingly specific collections.

It was something like browsing the shelves of a library.

You didn't necessarily need to know the title of the book you wanted. You could begin with a subject and see what was available.

One of the most influential examples was the Yahoo Directory, which grew from a guide to websites created in 1994.

The directory became an important part of how people navigated the early web.

Later, the Open Directory Project, commonly known as DMOZ, brought another approach: volunteers organising websites through a large, human-edited directory.

These were ambitious attempts to make an expanding internet understandable.

And for a time, they played a meaningful role.

Why the Great Web Directories Declined

The internet didn't stand still.

As more people came online, the number of websites grew enormously. Maintaining comprehensive collections became increasingly difficult.

At the same time, search engines improved.

Rather than relying on people to categorise websites manually, automated systems could discover pages, analyse their content and provide results for an extraordinary range of queries.

The convenience was difficult to compete with.

Why navigate through several layers of categories when you could type a question and receive a list of relevant results almost immediately?

The major directories gradually lost their central role.

The Yahoo Directory closed in December 2014.

DMOZ followed in March 2017, ending nearly nineteen years of volunteer efforts to organise the web under that project.

Their closures reflected a fundamental change in how people used the internet.

But they didn't necessarily prove that organising websites into collections had become worthless.

They showed that general-purpose directories were no longer the most convenient way to search an increasingly enormous web.

Those are two different conclusions.

And the distinction matters.

Search Engines Are Brilliant at Searching. But What About Browsing?

Consider someone who wants to learn about astronomy.

If they search for the distance between Earth and Mars, a search engine is an excellent starting point.

They have a specific question and want a reliable answer.

But suppose they simply want to explore astronomy-related websites.

They might enjoy finding amateur observatories, personal astrophotography projects, educational experiments, astronomy clubs or unusual collections of historical star charts.

A search engine can certainly help.

Yet it usually works best when the person can express what they want.

A well-organised directory offers another possibility.

Start with astronomy. Browse the websites. Discover a subject you hadn't considered.

The experience is less about finding a specific answer and more about encountering something interesting.

Neither approach is inherently superior.

They serve different purposes.

One prioritises finding.

The other can encourage wandering.

And perhaps the modern web could benefit from more opportunities to wander.

The Directory Didn't Completely Disappear

Although some famous directories closed, the underlying concept survived.

One particularly interesting example is Curlie.

Curlie continues the tradition of the Open Directory Project through a volunteer-edited directory organised into subjects and categories.

Its own documentation describes a mission focused on helping people identify and categorise useful web content.

Curlie demonstrates that human organisation remains possible, even in a world where automated search dominates.

But directories aren't the only projects exploring alternatives to mainstream discovery.

Marginalia Search is an independent search engine that prioritises non-commercial content and offers tools for exploring lesser-known websites.

It isn't a traditional directory.

Its importance here is that it approaches discovery differently.

Rather than trying to reproduce every feature of a major search engine, it gives particular attention to parts of the web that can be harder to encounter through familiar tools.

The IndieWeb community also documents a variety of discovery methods, including curated lists, personal website collections, independent-blog directories and webrings.

These projects differ in technology and purpose.

What connects them is an interest in helping people find websites beyond the most familiar online destinations.

That's a promising starting point for thinking about what directories could become.

What Would a Modern Website Directory Actually Need?

Simply collecting thousands of links is not enough.

Anyone can create a page filled with website addresses.

That doesn't make the collection useful.

A modern directory needs to offer something beyond the existence of links.

It needs organisation, clarity, relevance and enough maintenance to remain worth visiting.

1. Useful Categories

Categories should help visitors understand where to begin.

If someone is interested in education, they shouldn't need to search through hundreds of unrelated software products.

If they're looking for creative inspiration, they should be able to explore relevant websites without encountering endless promotional offers.

Good categories aren't merely labels.

They're a form of navigation.

And the best organisation makes exploring a directory feel natural rather than laborious.

2. Meaningful Website Descriptions

Imagine finding two entries for the same kind of website.

One says:

"Best online platform. Click here."

The other explains what the website does, who it's intended for and what visitors can actually find there.

Which is more useful?

A meaningful description gives visitors enough context to decide whether a link deserves their attention.

Website titles alone rarely tell the whole story.

The value of a directory often comes from making unfamiliar websites easier to understand.

3. A Clear Approach to Spam

This may be one of the biggest challenges facing modern directories.

Open submissions can attract automated spam, misleading websites, duplicate entries, affiliate redirects and other low-quality content.

A directory that accepts everything without meaningful checks risks becoming difficult to browse and potentially unsafe.

Automated screening can reduce obvious abuse.

Human editorial judgement can provide additional context where resources allow.

Neither method is perfect.

Automated systems can produce false positives and miss sophisticated threats. Manual reviews can be slow, inconsistent or expensive.

A responsible directory should acknowledge these limitations rather than claim every listed website is completely safe.

4. Maintenance After Publication

A website might be useful today and disappear next month.

It might change purpose, redirect elsewhere or become compromised.

This creates a problem that any directory operator eventually faces: a directory is not finished when a listing is published.

It requires ongoing attention.

Broken links, inaccurate descriptions and reported problems need practical ways to be corrected.

A smaller directory that receives regular maintenance may be more useful than an enormous collection that nobody checks.

5. A Reason for Visitors to Return

Perhaps the most important question is also the simplest.

Why would someone visit a directory if they weren't submitting a website?

This is where the future of directories becomes interesting.

A directory designed only for website owners looking for backlinks has limited appeal to ordinary visitors.

But a directory that helps people discover interesting projects, explore particular interests and find genuinely useful resources might offer a different kind of value.

The real audience shouldn't be only the people adding links.

It should also be the people following them.

Three Small Experiments in Website Discovery

I've been exploring these questions through three directory projects that I operate: Zearches, MeWebLink and ChipJourney.

They're related projects, not independent endorsements of one another, and each is an ongoing experiment in making website discovery more accessible.

Zearches is a free website submission and discovery directory organised around searchable categories. Website owners can submit their projects without paying a listing fee or providing a reciprocal backlink. Submissions undergo automated checks intended to reduce spam and duplication.

MeWebLink approaches website discovery through twelve broad categories and a screening process called AutoTrust. Eligible submissions can be published automatically, while existing listings are subject to periodic checks.

ChipJourney combines a searchable directory with an emphasis on curiosity and exploring useful websites across subjects such as technology, education, arts, travel and everyday interests. It also offers free submissions and automated screening.

These projects share an important design principle: visitors should be able to browse useful websites, while legitimate website owners should have a straightforward way to introduce their work.

That doesn't mean the directories have solved the problems discussed in this article.

Quite the opposite.

Building them has made those problems much more apparent.

How do you balance easy submissions with quality control?

How much information should a listing contain?

How do you keep categories meaningful as a directory grows?

How do you encourage visitors to explore rather than simply submit a link and leave?

These are practical challenges, not questions with obvious answers.

And the most useful lesson may be that a directory succeeds only when it serves readers as well as website owners.

The SEO Question Nobody Can Ignore

It's impossible to discuss website directories without addressing search engine optimisation.

For years, submitting websites to directories was commonly promoted as a way to obtain backlinks.

That reputation still influences how many people think about directory listings.

But the relationship between directories and search rankings is much more complicated than the simple idea that every backlink helps.

Google's spam policies specifically identify low-quality directory links and links created primarily to manipulate rankings as examples of problematic link practices.

The existence of a link does not guarantee a ranking benefit.

Nor does submitting a website guarantee that search engines will discover, index or prominently display it.

A modern directory should be honest about that.

For website owners, a sensible reason to submit is to make a project accessible to another relevant audience.

For visitors, the value is finding a useful resource.

If the entire experience revolves around manipulating rankings, the directory risks losing sight of both audiences.

There is a difference between a useful catalogue of websites and a collection of links created solely for search engines.

The future of directories depends partly on recognising that difference.

Could Artificial Intelligence Change Their Role Again?

A new development is complicating web discovery: artificial intelligence.

AI-powered interfaces can answer questions, summarise information and help people research unfamiliar subjects without requiring them to open every source.

This can make information easier to access.

But it also raises questions about the relationship between answers and the websites that produced the information.

What happens when people receive a useful summary but never visit the independent website behind it?

How do smaller publishers become visible when discovery increasingly happens through conversational interfaces?

And how will people encounter unfamiliar projects when they don't know what to ask for?

These questions don't have simple answers.

It's also too early to assume that directories will become an important part of AI-powered discovery.

But one possibility is worth considering.

Well-organised collections of websites, with accurate descriptions and clear subject categories, might remain useful resources for people and technologies attempting to understand what exists online.

That is a possibility, not a promise of increased AI visibility or referrals.

Even if AI changes the way people navigate the internet, the underlying need to discover relevant, trustworthy and interesting websites remains.

The methods may evolve.

The purpose doesn't necessarily disappear.

Perhaps the Future Is Smaller, Not Bigger

The most ambitious directories once attempted to organise enormous portions of the internet.

Perhaps the next generation doesn't need to do that.

Imagine a carefully maintained directory devoted entirely to independent photography projects.

Or a collection of educational websites created by teachers.

A directory of digital museums.

A catalogue of personal technology blogs.

A collection of community-run resources that rarely receive mainstream attention.

These projects wouldn't need to compete directly with global search engines.

They could focus on specific interests, clear organisation and carefully selected resources.

In fact, their smaller scale might be an advantage.

The more focused the collection, the easier it may be to understand what belongs and what doesn't.

A directory that tries to list everything can struggle to explain why anyone should visit.

A directory with a distinctive purpose has a better chance of becoming genuinely useful.

How to Recognise a Directory Worth Using

Whether you're exploring websites or considering submitting your own, a few questions can help you judge a directory.

  • Does it have a clear purpose? The categories and listings should make sense together.

  • Are the descriptions useful? You should understand what a website offers before clicking.

  • Are the listings reasonably maintained? Broken or misleading links should have a reporting or correction process.

  • Is the submission process transparent? Fees, restrictions and approval rules should be clear.

  • Does it make unrealistic promises? Guaranteed traffic, rankings or instant SEO success should invite scepticism.

  • Would you browse it yourself? This may be the most revealing question of all.

A worthwhile directory doesn't need millions of listings.

It needs enough useful information to reward someone for visiting.

A Different Kind of Comeback

Will website directories return to the position they held in the early days of the internet?

Almost certainly not in exactly the same form.

Search engines are far too useful, and the modern web is far too large, for a simple catalogue to replace them.

But perhaps that isn't the right ambition.

The directory's greatest opportunity may lie in doing something search engines don't always prioritise: encouraging people to browse, explore and encounter websites they weren't specifically looking for.

A well-designed directory can become a doorway into a subject.

A carefully maintained collection can highlight independent work.

A thoughtful description can turn an unfamiliar URL into something inviting.

None of these things requires the directory to become the centre of the internet.

It simply needs to make a small part of the web easier to discover.

And perhaps that is what a meaningful comeback would look like.

Not the return of enormous catalogues that attempt to organise everything.

Not thousands of links collected for search rankings.

But smaller, more useful spaces created for people who still enjoy the simple pleasure of finding something interesting online.

The internet doesn't need directories to replace search engines.

It might simply benefit from having more ways to explore.

Further Reading and Exploration

The Open Web Journal explores internet culture, independent publishing and the changing ways people discover websites.