This chapter explains the need for a new dimension in the evaluation of the benefits of information technology where the technology has impact is on the broader society rather than just on the organization that implements it. In the early 1990s, when DeLone and McLean (1992) developed their framework, the benefits described were intra-organizational. A decade later, many major IT systems directly impact on the society within which they function. This is the especially true of systems designed to provide the interface between government and the private sector. Additionally, the procurement environment is increasingly becoming more complex for practitioners with new e-marketplace developments. This case illustrates specific peculiarities and constraints on public sector use of e-marketplaces. It provides an evaluation framework that can be used by public sector organizations when examining the adoption and evaluation of e-marketplace procurement that emphasizes the experimental nature of many e-commerce related projects.