Linear Feedback Shift Registers are a commonly used method of producing pseudo-random sequences with large period. This paper investigated another applications of the third-order linear feedback shift register sequence (3-LFSR). It proposed two methods for directly constructing probabilistic public-key encryption primitives. The proposed probabilistic encryption schemes have properties of one-wayness and semantic security.