Personally I would not allow a castor bean plant anywhere near the house or where small children are going to play as the seed pods are extremely poisonous.  They are the source ricin, which Agatha Christie used to great effect in some of her novels.