2006cihass Marciano talk

T-Races: 

T-Races A Testbed for the Redlining Archives of California’s Exclusionary Spaces Richard Marciano Sustainable Archives & Library Technologies (SALT) DICE Group @ SDSC and Urban Studies and Planning @ UCSD marciano@sdsc.edu

T-Races Project: 

T-Races Project SDSC & UCHRI (University of California Humanities Research Institute): David Goldberg, Kevin Franklin, Suzy Beemer Develop a distributed framework for the preservation, presentation, and analysis of historical resources relating to the development of exclusionary urban spaces in the 1930s and 1940s T-Races will build on the HASS grid and: Demonstrate the creation of regional collections, federated into national holdings Enable new modes of multidisciplinary research Vectorize redlining maps and link them with their associated documents

Using a Data Grid - Details: 

Using a Data Grid - Details SRB MCAT DB SRB SRB SRB SRB SRB Data Grid has arbitrary number of servers Heterogeneity is hidden from users

Shared Collections: 

Shared Collections Cyberinfrastructure - support sharing of resources between sites Grids - support shared computation Data Grids - support shared collections Shared collection Manage the intellectual capital of a community Promote access to community digital holdings Enable authoritative sources of information Enable collaborative building of collection

Using a Data Grid – in Abstract: 

Data Grid Using a Data Grid – in Abstract User asks for data from the data grid

Using a Data Grid - Details: 

Using a Data Grid - Details Data request goes to SRB Server Server looks up data in catalog Catalog tells which SRB server has data 1st server asks 2nd for data The data is found and returned User asks for data

Using a Data Grid - Details: 

Using a Data Grid - Details SRB MCAT DB SRB SRB SRB SRB SRB Data Grid has arbitrary number of servers Heterogeneity is hidden from users

The SRB, an example of a Data Grid: 

The SRB, an example of a Data Grid A distributed file system (Data Grid), based on a client-server architecture. It’s also more: It provides a way to access files and computers based on their attributes rather than just their names or physical locations. It replicates, syncs, archives, and connects heterogeneous resources in a logical manner using abstraction mechanisms.

Shared Collections: 

Shared Collections Purpose of SRB data grid is to enable the creation of a collection that is shared between academic institutions Register digital entity into the shared collection Assign owner, access controls Assign descriptive, provenance metadata Manage state information Audit trails, versions, replicas, backups, locks Size, checksum, validation date, synchronization date, … Manage interactions with storage systems Unix file systems, Windows file systems, tape archives, … Manage interactions with preferred access mechanisms Web browser, Java, WSDL, C library, DSpace, portals, GIS, …

Data Grid Federations: 

Data Grid Federations Establish mechanisms to share data, metadata, storage resources between independent data grids Establish trust mechanism between two data grids Register a user into the remote data grid Can then read data from the remote data grid without having to log in a second time

Examples of International Grids: 

Examples of International Grids LATAgrid: Latin America Grid Worldwide Universities Network: WUN Global Grid Forum interoperability testbed. Federation of 14 independent data grids across Australia, New Zealand, Taiwan, Japan, the United State, the United Kingdom, the Netherlands, France, Italy, and Chile. Actually, many of the data grids were themselves federations of data grids within a country. The interoperability testbed showed that a user could sign on to a local data grid, and then under managed access controls read and write data in any of the other 13 data grids. There are no impediments to creating shared collections that are international in scope. the Australian Partnership for Advanced Computing data grid, the Academia Sinica Grid Computing Centre data grid in Taiwan, the Integrative Biology data grid in New Zealand and the United Kingdom, the IN2P3 national institute of nuclear physics and particle physics data grid in France, the US National Optical Astronomy Observatory data grid in the US and Chile, the DEISA Distributed European Infrastructure for Supercomputing Applications data grid in Italy, the KEK High Energy Accelerator Research Organization data grid in Japan, the SARA data grid in the Netherlands, the NCHC National Center for High-Performance Computing data grid in Taiwan, the Rutherford Appleton Laboratory data grid in the United Kingdom, the Purdue University data grid in the US, the Teragrid in the US, and the NARA preservation data grid at the University of Maryland in the US.

HASS Grid: 

HASS Grid UCHRI launches HASS Grid in 2005 HASS – Humanities, Arts, and Social Sciences Based on cyberbricks (storage computers) Low-cost, scalable, long-term archive for data collections, up to 25TB of storage planned Testbed for U. of California researchers Based on SDSC’s Storage Resource Broker (SRB) Current Status: Six nodes, 2-3 TBs per node, UCSD, UCI, UCLA, UCB, Cal State, National University. SRB loaded and additional 5 additional bricks in the next 90 days.

HASS Grid: 

HASS Grid UC Berkeley …

Persistent Archives Testbed (PAT): 

Persistent Archives Testbed (PAT) Building Preservation Environments for State Archives Testing proven technologies in new environments Exploring the use of data grid technology to support preservation

PAT Testbed: 

PAT Testbed Explore advantages of national preservation infrastructure Shared use of preservation resources Shared evaluation of new technology Demonstration of generic infrastructure Shared development of archival procedures Expanded assessment of technology across diverse types of records Shared risk Collaborative use of preservation environment by multiple states

PAT Project: 

PAT Project Test a community model for electronic records management, with archival and technological functions in a distributed network (using the SRB: Storage Resource Broker – data grid technology) Initial Test sites: (1) Michigan Department of History, Arts and Libraries, (2) Ohio Historical Society, (3) Kentucky Department for Libraries and Archives, (4) Minnesota Historical Society, (5) SLAC Stanford Linear Accelerator Archives and History Office. Participants: California State Archives Kansas State Historical Society University of Illinois Urbana Champaign University of California Los Angeles (UCLA): (e) Yale Manuscripts and Archives (f) Georgia Tech Observers: (a) Getty

Shared Infrastructure: 

Shared Infrastructure SDSC Archive MCAT Local Storage Resources Shared Preservation Environment Metadata Catalog (Oracle) Archival Storage (HPSS, Sam-QFS)

Shared Development of Archival Processes: 

Shared Development of Archival Processes The processes that are being automated are: appraisal, accessioning, arrangement, description, Preservation, access.

Archival Processes explored in PAT: 

Archival Processes explored in PAT  

What’s in a Color?: 

What’s in a Color? Severe Condition == Severe risk of terrorist attacks. High Condition == High risk of terrorist attacks. Elevated Condition == Significant risk of terrorist attacks. Guarded Condition == General risk of terrorist attack. Low Condition == Low risk of terrorist attacks.

Risk & Security-- and --** The Residential Security Map **: 

Risk & Security -- and -- ** The Residential Security Map ** Confidential HOLC Residential Security Maps of the 1930s and 1940s

Slide23: 

"Green areas are "hot spots"; they are not yet fully built up. In nearly all instances they are the new well planned sections of the city, and almost synonymous with the areas where good mortgage lenders with available funds are willing to make their maximum loans to be amortized over a 10-15-year period -- perhaps up to 75-80% of the appraisal. They are homogeneous; in demand as residential locations in "good time" or "bad"; hence on the upgrade".

Slide24: 

"Blue areas, as a rule, are completely developed. They are like a 1935 automobile – still good, but not what the people are buying today who can afford a new one. They are the neighborhoods where good mortgage lenders will have a tendency to hold loan commitments 10-15% under the limit."

Slide25: 

"Yellow areas are characterized by age, obsolescence, and change of style; expiring restrictions or lack of them; infiltration of a lower grade population; the presence of influences which increase sales resistance such as inadequate transportation, insufficient utilities, perhaps heavy tax burdens, poor maintenance of homes, etc. "Jerry" built areas are included, as well as neighborhoods lacking homogeneity. Generally, these areas have reached the transition period. Good mortgage lenders are more conservative in the Yellow areas and hold loan commitments under the lending ratio for the Green and Blue areas.”

Slide26: 

"Red areas represent those neighborhoods in which the things that are now taking place in the Yellow neighborhoods, have already happened. They are characterized by detrimental influences in a pronounced degree, undesirable population or infiltration of it. Low percentage of home ownership, very poor maintenance and often vandalism prevail. Unstable incomes of the people and difficult collections are usually prevalent. The areas are broader than the so-called slum districts. Some mortgage lenders may refuse to make loans in these neighborhoods and other will lend only on a conservative basis."

Redlining: 

Redlining “Between 1934 and 1962 FHA and VA (through the GI Bill) financed over $120 Billion of new housing and less than 2% of this real estate was available to nonwhite families, mostly in segregated areas.” “Low- and moderate-income neighborhoods of all races make up more than 27 percent of San Diego County’s population, yet those neighborhoods received just 13 percent of conventional loans. Given that homeownership remains the single most important source of accumulated wealth for minority and lower-income American households, it is impossible to overstate the damage caused by these inequalities.” [1] [1] According to a recently released study by ACORN, the Association of Community Organizations for Reform Now, an advocacy group for low-and moderate-income families.

A Tale of 2 Regions: 

A Tale of 2 Regions

New Orleans: 

New Orleans Section D-3: This area is made up principally of small double cottages with some negro population. Properties are generally of the double cottage type with some few singles, values range from $1200. to $3500. Properties poorly maintained as a rule, average age 30 years. Population largely negroes and whites of poor circumstances. Section D-4: This area surrounds Dillard University for negroes, Mt. Olivet Cemetery for negroes and due to this condition it would seem logical to believe that only the cheaper type of house will be built here. At this time there are only a few very cheaply constructed properties and the area is only about 10% improved. Population is mostly negroes.

Mapping of UC Storage Nodes to RL Cities: 

Mapping of UC Storage Nodes to RL Cities

HASS Grid: 

HASS Grid UC Berkeley …

Slide37: 

The San Diego Connection

A Model House in FHA Model Town – California Pacific Exposition of San Diego. -- 1935.: 

A Model House in FHA Model Town – California Pacific Exposition of San Diego. -- 1935.

FHA Model Town – California Pacific Exposition of San Diego – 1935. : 

FHA Model Town – California Pacific Exposition of San Diego – 1935.

The Local Input: 

The Local Input Confidential Residential Security Maps for all major U.S. cities were prepared by the Home Owners' Loan Corporation (HOLC), with special assistance from "competent local real estate brokers and mortgage lenders, believed to represent a fair and composite opinion of the best qualified local people". HOLC Division of Research and Statistics with Cooperation of the Appraisal Department, San Diego, October 20, 1936.

FHA: 

FHA "Protection against adverse influences is obtained by the existence and enforcement of proper zoning regulations and appropriate deed restrictions.“ "Important among adverse influences are the following: infiltration of inharmonious racial or nationality groups; the presence of smoke, odors, fog, etc.“ FHA Underwriting Manual (August 1, 1935) section 309, section 310

Realtors: 

Realtors "A Realtor should never be instrumental in introducing into a neighborhood a character of property or occupancy, members of any race or nationality, or any individual whose presence will clearly be detrimental to property values in the neighborhood.“ National Association of Real Estate Brokers (NAREB) (Code of Ethics: 1922 -- amended in 1952): Article 34

Appraisers: 

Appraisers “If a neighborhood is to remain stable, it is necessary that properties shall continue to be occupied by the same racial and social classes. Changes in social or racial occupancy contribute to neighborhood instability and the decline of value levels.“ Frederick Babcock, Director of FHA Underwriting Division (April, 1938), "The Journal of the American Institute of Real Estate Appraisers of the National Association of Real Estate Boards", Volume VI, April 1938, Number 2, p. 137, "Techniques of Residential Location Rating"

Deeds: 

Deeds The usual manner of imposing a deed restriction is to insert an appropriate provision in the deed by which property is transferred. The restriction should be in record form in the chain of title of each lot. Otherwise if a lot is old to a purchaser who has no knowledge of the restriction, he will not be bound by it.“ Homer Hoyt, Principal Housing Economist, Division of Economics & Statistics FHA, "Principles of Urban Real Estate" (1948), p. 194

Equity, Economy, Environment?: 

Equity, Economy, Environment? Area A7 Area B11

Los Angeles: D33, D34, D53, D57: 

Los Angeles: D33, D34, D53, D57

Los Angeles (cont): D33, D34, D53, D57: 

Los Angeles (cont): D33, D34, D53, D57