Many people I know have visited the Norton Simon a number of times and never been downstairs. Even if you only have a few minutes, I would highly recommend a stroll through the Asian Art Collection. Works from India dominate, but Tibet, Nepal, Cambodia, Thailand and other South and Southeast Asian countries are also represented. There are plenty of the typical statues of Buddha, Vishnu and Ganesh, but also excellent representations of the playfulness and eroticism found in South Asian art.
The temporary exhibit galleries are also downstairs, featuring rotating exhibits from the permanent collection.