avoid creating PyRef inside __traverse__ handler

avoid creating PyRef inside __traverse__ handler #5367