Heat olive oil in a large, deep skillet over medium high heat. Season chicken with salt and pepper. Arrange half of the chicken in the skillet, skin side down, and cook, without flipping, until skin is golden brown, 8 to 10 minutes. Transfer to a large plate and repeat with remaining chicken.