I imagine you could use the confidence-value output of the object-detection API as input into a separate system that would also incorporate the other inputs you mention.