Cell migration in confined environments is fundamental for diverse biological processes from cancer invasion to leukocyte trafficking. The cell body is propelled by the contractile force of actomyosin networks transmitted from the cell membrane to the external substrates. However, physical determinants of actomyosin-based migration capacity in confined environments are not fully understood. Here, we develop an in vitro migratory cell model, where cytoplasmic actomyosin networks are encapsulated into droplets surrounded by a lipid monolayer membrane. We find that the droplet can move when the actomyosin networks are bound to the membrane, in which the physical interaction between the contracting actomyosin networks and the membrane generates a propulsive force. The droplet moves faster when it has a larger contact area with the substrates, while narrower confinement reduces the migration speed. By combining experimental observations and active gel theory, we propose a mechanism where the balance between sliding friction force, which is a reaction force of the contractile force, and viscous drag determines the migration speed, providing a physical basis of actomyosin-based motility in confined environments.