The
Metadirectory:
A Directory for the Real World
by Steve Tillery, Fischer
International Systems Corporation.
(Originally published in Messaging Magazine, July/August
1999)
A hybrid of metadirectory types will address real-world, global enterprise needsextending information boundaries, providing security, authenticity, and integrity.
Todays corporate information systems rely on a variety of hardware, software, and network platforms. A metadirectory solution must be capable of managing the corporate information knowledge base, as well as provide secure access to information across a variety of distributed platforms. A metadirectory must also reduce corporate risk, increase productivity, and help protect IT investments.
Large organizations typically have mainframe computers, various network topologies, server farms of both NT and Unix servers, as well as end-user client computers with varying operating systems. Communication between these computers may depend upon different types of networks within the enterprise, as well as networks that cross corporate boundaries worldwide. Multiple e-mail systems, a variety of software products managing corporate data, the location and politics surrounding ownership of data, create access control, security, and administration problems that result in corporate risk, and a loss of productivity.
Employee information in a large organization might reside in a human resource database, with a more limited set of information available in a telephone directory, a departmental directory, or perhaps in databases being managed by various corporate software packages. Much of the information is redundant, and in many cases administrated manually.
E-mail as a means of efficient communication added a significant layer of complexity over the directory needs of the large corporation. Directory information was required not only to link e-mail addresses to individuals, but also to route the mail itself. Extending e-mail services to remotes, users, customers, and business partners, across corporate boundaries, drove the need for secure remote access to corporate data. Remote access, in turn, opened up the way for customers and vendors alike to improve communications and just-in-time inventory management.
E-commerce is increasing the level of complexity once again, demanding authentication, confidentiality, integrity, and non-repudiation services. The increased volume of access to corporate information is expected to increase the need for reliability and scalability of e-commerce applications. Directory services will be a key component of any e-commerce infrastructure. The need for directory services is expected to increase significantly over the next three years with revenues estimated to be $78.4 million by 2002 and professional services over $300 million.1
Enter the Metadirectory
A metadirectory can act like a central clearinghouse for access to corporate information providing security, integrity, and authentication. Metadirectories reduce the cost of managing corporate information over existing directory methods and provide an infrastructure for managing the needs of e-commerce. By moving to a single, electronic telephone directory, one large company was able to eliminate nearly all of the $1,000,000 per year they were spending to publish a paper telephone directory.2 The U.S. Department of Transportation was able to save at least $20 million just through better e-mail directory access, on a total investment of $600,000 for the entire metadirectory solution.3
Although GartnerGroup identifies three different techniques (replication-based, virtual directory, and directory information broker)4 to create a metadirectory function to meet todays needs, the metadirectory will need to combine at least two of these techniques.
Even an information broker type of directory needs YETAa directory of pointers
The need for another directory (YETA directory) to consolidate the data in the many
corporate repositories seems like a contradiction to many. No matter the approach,
however, yet another directory will be required. Replication-based metadirectories will
move corporate information to an industry standard distributed repository where an
enterprise security policy may be applied to the information. The Virtual directory pushes
the solution to client platforms creating somewhat of a client platform administration
problem, while compromising the organizations flexibility to manage information. The
directory information broker will need a YETA directory containing pointers to information
in other repositories. Politics regarding information ownership, location, and security,
will demand that the replication technique also accommodate the information broker
technique, forming a hybrid of the two.
A corporate metadirectory must be capable of managing the organizations knowledge
base, securing sensitive information, and distributing the information inside or outside
of the corporate firewall!
Only replication-based metadirectories offer the speedy access required for most
applications. Information is captured in an industry standard repository. The
organizations security policy may be applied to information before shadowing the
information to distributed directory servers within the organization, or beyond corporate
boundaries to business partners. Yet, due to processing requirements, ownership, or
politics, certain information may not be able to be moved to the metadirectory repository.
Pointers to this information, along with pointers to information in a replication-based
metadirectory, comprise your metadirectory knowledge base. A replication-based
metadirectory has the machinery required to manage a knowledge base, secure the
information, and distribute it across a variety of platforms throughout an organization,
as well as to locations outside of the corporate firewall.
Metadirectory information must be managed independent of client applications, across
organizational boundaries in the real-world, multinational corporation.
One of the main benefits to a metadirectory is the ability to securely manage corporate
information, across industry standard protocols, independent of client applications. It is
critical, that when the clientthe employee, vendor, or e-commerce
customeraccesses the metadirectory, that the location of information and access
control issues are handled by the metadirectory backbone, and not referred to the client.
If the requested data is not available on the boundary directory server, the metadirectory
knowledge base should allow the backbone to locate the data rather than referring the
client to another directory solution. Figure 1 shows an example metadirectory
implementation where the client accesses corporate information from a boundary directory
server. If the information is located on another directory server, in another repository
outside the metadirectory, or possibly in a trading partners data center, the
metadirectory backbone obtains the information and securely transfers it to the client.

While the installed base of LDAP-based software requires LDAP compatibility in the metadirectory, LDAP will not, by itself, satisfy all the requirements for managing metadirectory information. With LDAP, the client can only retrieve information from directory servers defined to the LDAP client. If the desired information is not resident on the designated LDAP server, a referral is returned to the client. The client must then attempt to access other LDAP servers in its quest for the desired information. Figure 2 shows the resulting communication flow. In addition to the overhead required to access the referred LDAP servers, access control becomes a serious issue, as each server needs to know about each and every client.

X.500 protocols supply the machinery required to manage metadirectory information. Combined with LDAP as a client protocol, a wide variety of client applications may access the metadirectory backbone. The protocols found in X.500, represent the machinery an organization needs to manage metadirectory information across a variety of distributed platforms worldwide. Client platforms as well as other directory-enabled applications are independent of the metadirectory implementation. With X.500-like machinery, whether the metadirectory repository physically holds corporate information or another repository holds the data, is no longer an issue that concerns the client. Metadirectory security and protocol technologies also address communication and security issues pertaining to various repositories. The client authenticates itself to the metadirectory backbone, and information is made available securely according to a corporate security policy. Organizations are free to reorganize the topology of metadirectory backbones according to their e-commerce needs.
Active Directory will become a de facto standard within NT networks. The
Metadirectory can be integrated with Active Directory.
Microsoft has a history of developing de facto standards for the PC-based computing
world. With the introduction of Active Directory with Windows NT 2000, Microsoft will,
arguably, spawn a new standardone of a directory communications interface. As
software developers the world over write software that interface using the Active
Directory Service Interface (ADSI, Microsofts interface for Active Directory), the
need to support this protocol with the metadirectory is evident. In addition to LDAP and
X.500, the successful metadirectory must also support Active Directory. The question is
"Will Microsoft applications evolve away from LDAP using ADSI as their directory
interface?" If that is the case, the next question becomes "Does LDAP become an
Active Directory interoperability component to existing standalone LDAP servers?"
The metadirectory must run on todays hardware and software topologies, meeting necessary scalability requirements, while providing growth potential for the future.
As the benefits of metadirectory technology are realized, organizations will become clever about inventing ways to leverage metadirectory resources. Process automation, digital certificate management, directory-enabled networking, as well as other e-commerce applications will increase the use of metadirectory exponentially. Organizations and their businesses will become increasingly dependent on their metadirectory resource. Reliability, scalability, and availability are critical. Once a metadirectory is in place, usage will demand 100% availability. Careful consideration should be given towards the type of metadirectory technology, the platforms it runs upon, and the reliability and scalability of the entire solution.
Conclusion
A new metadirectory structure is needed that encompasses the needs of Fortune 500 companies and offers access to information across all enterprise platforms.
The metadirectories proposed to date do not address the needs of Fortune 500 companies. These companies need, as a minimum:
In real-world terms, the successful metadirectory needs to be an information broker with a replication capability. It needs to run on a variety of platforms including NT, Unix, as well as the IBM S/390 mainframe. It needs to interoperate with other metadirectory solutions with support for LDAP, X.500, and Active Directory. We look forward to the introduction of this type of metadirectory into the marketplace. MM
Footnotes
1. Radicati Group, "The Directory Services Market & Product
Analysis 19982002," 1998.
2. "Mail Directory Battles Intensify," WEBWEEK,
v.3(12), 1997.
3. Alexis Bor, "Enterprise Directories, Now More Than Ever,"
1997.
4. See Goldsmith and Mulqueen, "Meta Directory: The Technology
Differences," Messaging Magazine, March/April 1999, for a complete
discussion of these techniques.