Large Scale Service Oriented Architecture (SOA) developments are becoming increasingly reliant on registry services that manage Web Services using taxonomic attributes. A registry stores a Web Service's interface definition and protocol bindings in WSDL format, along with one or more XML schema files that define the structure of a SOAP message exchanged between Web Service operations and client processes and other static metadata. During Web Service discovery, an ebXML registry returns the access URI associated with a service binding to allow dynamic Web Service invocation. This usually restricts a calling process to a Web Service invocation on a single host. This thesis presents an architecture that manages service bindings for Web Services that have been deployed across multiple hosts such that a URI returned by a ebXML registry can resolve to a host that satisfies different system constrains like current CPU load, physical memory, swap memory, and time of day. This architecture involves the design and development of a new scheme for ebXML registries that facilitate the periodic collection and management of dynamic system properties for registry clients and the enforcement of constraints during service discovery and operation invocation. The proposed scheme is unique as it extends the existing freebXML registry implementation by adding load balancing features along with other QoS capabilities. Furthermore, our scheme is transparent to an end user as no significant code changes are required by a user to utilize this load balancing architecture. Using our modified ebXML registry, it is possible to implement a many task computing (MTC) application using distributed Web Services in an effective way across multiple hosts where the CPU load and system memory is uniformly maintained.