This is just a hunch...
Even though the construction of the button (domed, one-piece) seems earlier--I feel pretty certain that because of the design content on the button's face it must date to later (Victorian Era).
Now I wonder if this piece might be something from the influx of Japanese themed art in the states in the 1880s and a little later... (Our term "China" to describe the plates we eat from comes from this time in American history.)
There is a kimono-style robe, an oriental-style fan, and perhaps even an exotic bird.
Something from a production of the Mikado? Or maybe the button came off of the cuff of a kimono-like garment made for the Western market?
I'm still looking--hopefully I'll turn something up.
-Buckles