One thing that I tried that helped me pick up more Japanese (I took a couple classes in college) was to join a couple of Pen Pal sites for Japanese speakers, and chatting on MSN and things - doing a trade for english skills for japanese skills. I also mentored ESL for Japanese co-op students in college - don't know if thats a possibility either.

a couple sites:
http://www.polyglot-learn-language.com/ (look up Japanese speakers)
http://www.japan-guide.com/local/
http://www.nk.rim.or.jp/~hirokun/index2.html

Also, I like Glacier's suggestion to contact the local tourist board - maybe they have some information, or the possibillity to volunteer to show the sites to some Japanese visitors? Also, depending on your situation, theres always homestay programs, or being a host home for japanese students (i did that for one semester, and it was a lot of fun)