You can have a router in twilio then match the numbers you want to connect or don't want to connect. So CALL -> TWILIO -> ROUTER -> VAPI...