Many art museums throughout history have been designed with a cultural purpose or been subject to political intervention. In particular National Art Galleries have been thought to incite feelings of nationalism. This has occurred in both democratic and non-democratic countries, although authoritarian regimes have historically exercised more control over administration of art museums. Ludwig Justi was for example dismissed as director of the The Alte Nationalgalerie (Old National Gallery) in Berlin in 1933 by the new Nazi authorities for not being politically suitable.

Since the 1970s a number of political theorists and social commentators have pointed to the political implications of art museums and social relations. Pierre Bourdieu, for instance, argued that in spite the apparent freedom of choice in the arts, people's artistic preferences (such as classical music, rock, traditional music) strongly tie in with their social position. So called Cultural Capital is a major factor in social mobility (for example, getting a higher-paid, higher-status job). The argument states that certain art museums are aimed at perpetuating aristocratic and upper class ideals of taste and excludes segments of society without the social opportunities to develop such interest. The fine arts thus perpetuate social inequality by creating divisions between different social groups. This argument also ties in with the Marxist theory of mystification and elite culture.

Furthermore, certain art gallerias, such as the National Gallery in London and the Louvre in Paris are situated in buildings of considerable emotional impact. The Louvre in Paris is for instance located in the former Royal Castle of the ancient regime, and is thus clearly designed with a political agenda. It has been argued that such buildings create feelings of subjugation and adds to the mystification of fine arts.

Works on paper, such as drawings, pastels, watercolors, prints, and photographs are typically not permanently displayed for conservation reasons. Instead, public access to these materials is provided by a dedicated print study room located within the museum. Murals generally remain where they have been painted, although many have been removed to galleries. Various forms of 20th century art, such as land art and performance art, also usually exist outside a gallery. Photographic records of these kinds of art are often shown in galleries, however. Most museum and large art galleries own more works than they have room to display. The rest are held in reserve collections, on or off-site.

Similar to an art gallery is the sculpture garden (or sculpture park), which presents sculpture in an outdoor space. Sculpture installation has grown in popularity, whereby temporary sculptures are installed in open spaces during events like festivals.

The architectural form of the art gallery was established by Sir John Soane with his design for the Dulwich Picture Gallery in 1817. This established the gallery as a series of interconnected rooms with largely uninterrupted wall spaces for hanging pictures and indirect lighting from skylights or roof lanterns.

The late 19th century saw a boom in the building of public art galleries in Europe and America, becoming an essential cultural feature of larger cities. More art galleries rose up alongside museums and public libraries as part of the municipal drive for literacy and public education.

In the middle and late 20th century earlier architectural styles employed for art museums (such as the Beaux-Arts style of the Metropolitan Museum of Art in New York City or the Gothic and Renaissance Revival architecture of Amsterdam's Rijksmuseum) were increasingly replaced with more modern styles, such as Deconstructivism. Examples of this trend include the Guggenheim Museum in New York City by Frank Lloyd Wright, Frank Gehry's Guggenheim Museum Bilbao and Mario Botta's redesign of the San Francisco Museum of Modern Art. Some critics argue that these galleries are self-defeating, in that their dramatic interior spaces distract the eye from the paintings they are supposed to exhibit.