All recognizances taken and forfeited before any district judge or magistrate, shall be forthwith certified to the clerk of the superior court of the county; and it shall be the duty of the prosecuting attorney to proceed at once by action against all the persons bound in such recognizances, and in all forfeited recognizances whatever, or such of them as the prosecuting attorney may elect to proceed against.