We propose to use bending type tri-layer polymer actuators as propulsion fins for a biomimetic device consisting of a rigid body, like a box fish having a carapace, and paired fins running through the rigid body, like a fish having pectoral fins. The fins or polymer bending actuators can be considered as individually controlled flexible membranes. Each fin is activated with sinusoidal inputs such that there is a phase lag between the movements of successive fins to create enough thrust force for propulsion. Eight fins with 0.125 aspect ratio have been used along both sides of the rigid body to move the device in the direction perpendicular to the longitudinal axis of the body. The designed device with the paired fins was successfully tested, moving in an organic solution consisting of solvent, propylene carbonate (PC), and electrolyte. The design procedure outlined in this study is offered as a guide to making functional devices based on polymer actuators and sensors.