Heat the oil in a large pot or saucepan. Add the chicken thighs, season with salt, pepper, and chili powder. Sauté for 1-2 minutes. Flip and season the other side. Cover the thighs with chicken broth and bring to a boil. Boil until the chicken is cooked through and no longer pink in the center.