Skip to main content
SpringerLink
Log in

On optimizing the satisfiability (SAT) problem

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

The satisfiability (SAT) problem is a basic problem in computing theory. Presently, an active area of research on SAT problem is to design efficient optimization algorithms for finding a solution for a satisfiableCNF formula. A new formulation, theUniversal SAT problem model, which transforms the SAT problem on Boolean space into an optimization problem on real space has been developed. Many optimization techniques, such as the steepest descent method, Newton's method, and the coordinate descent method, can be used to solve theUniversal SAT problem. In this paper, we prove that, when the initial solution is sufficiently close to the optimal solution, the steepest descent method has a linear convergence ratio β<1, Newton's method has a convergence ratio of order tow, and the convergence ratio of the coordinate descent method is approximately (1-β/m) for theUniversal SAT problem withm variables. An algorithm based on the coordinate descent method for theUniversal SAT problem is also presented in this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Dershowitz N, Hsiang J, Josephson N, Plaisted D. Associative-commutative rewriting. InProceedings of IJCAI, 1983, pp. 940–944.

  2. Hsiang J. Refutational theorem proving using term-rewriting systems.Artificial Intelligence, 1985, 16: 255–300.

    Article  MathSciNet  Google Scholar 

  3. Shensa M J. A computational structure for the propositional calculus. InProceedings of IJCAI, 1989, pp. 384–388.

  4. P C Jackson Jr. Heuristic search algorithms for the satisfiability problem. Submitted to the third IEEE TAI Conference, Jul. 1991.

  5. Nilsson N J. Principles of Artificial Intelligence. Tioga Publishing Company, Palo Alto, California, 1980.

    MATH  Google Scholar 

  6. Winston P H. Artificial Intelligence. Addison-Wesley, Reading, 1984.

    MATH  Google Scholar 

  7. Davis M, Putnam H. A computing procedure for quantification theory.J. ACM, 1960, 7: 201–215.

    Article  MATH  MathSciNet  Google Scholar 

  8. Gu J. How to solve very large-scale satisfiability problems. Technical Report UUCS-TR-88-032. 1988, and UCECE-TR-90-002, 1990.

  9. Gu J. Efficient local search for very large-scale satisfiability problem.SIGART Bulletin, Jan. 1992, 3(1): 8–12, ACM Press.

    Article  Google Scholar 

  10. Gu J, Gu Q P. Average time complexities of several local search algorithms for the satisfiability problem. Technical Report UCECE-TR-91-004, 1991. InLecture Notes in Computer Science, 1994, 834: 146–154, and to appear inIEEE Trans. Knowledge and Data Engineering.

  11. Koutsoupias E, Papadimitriou C H. On the greedy algorithm for satisfiability.Information Processing Letters, 10 Aug. 1992, 43: 53–55.

    Article  MATH  MathSciNet  Google Scholar 

  12. Gu J. On Optimizing a Search Problem. InAdvanced Series on Artificial Intelligence, Jan. 1992, 1 (Chapter 2): 63–105.

  13. Gu J. Global optimization for satisfiability (SAT) problem.IEEE Trans. Knowledge and Data Engineering, Jun. 1994, 6(3): 361–381, Feb. 1995, 7(1):192.

    Article  Google Scholar 

  14. Gu J, Purdom P W, Franco J, Wah B W. Algorithms for satisfiability (SAT) problem: A survey.DIMACS Volume Series on Discrete Mathematics and Theoretical Computer Science. The Satisfiability (SAT) Problem, 1997, 35: 19–151, American Mathematical Society.

    MathSciNet  Google Scholar 

  15. Mackworth A K. Consistency in networks of relations.Artificial Intelligence, 1977, 8: 99–119.

    Article  MATH  Google Scholar 

  16. Bitner J R, Reingold E M. Backtrack programming techniques.Comm. ACM, Nov. 1975, 18(11): 651–656.

    Article  MATH  Google Scholar 

  17. Brown C A, Purdom P W. An average time analysis of backtracking.SIAM J. Computing, Aug. 1981, 10(3): 583–593.

    Article  MATH  MathSciNet  Google Scholar 

  18. Bugrara K, Purdom P. Clause order backtracking. Technical Report 311, 1990.

  19. Larrabee T. Test pattern generation using Boolean satisfiability.IEEE Trans. Computer-Aided Design, Jan. 1992, 11(1): 4–15.

    Article  Google Scholar 

  20. Purdom P W. Search rearrangement backtracking and polynomial average time.Artificial Intelligence, 1983, 21: 117–133.

    Article  Google Scholar 

  21. Siegel P. Representation et Utilization de la Connaissances en Calcul Propositionel. Ph.D. thesis, University Aix-Marseille II, 1987.

  22. Ashar P, Ghosh A, Devadas S. Boolean satisfiability and equivalence checking using general Binary Decision Diagrams.Integration, the VLSI journal, 1992, 13(1): 1–16.

    Article  Google Scholar 

  23. Bryant R E. Graph-based algorithms for Boolean function manipulation.IEEE Trans. Computers, Aug. 1986, C-35(8): 677–691.

    Article  MATH  Google Scholar 

  24. Gelder A V. A satisfiability tester for non-clausal propositional calculus.Information and Computation, Oct. 1988, 79(1): 1–21.

    Article  MATH  MathSciNet  Google Scholar 

  25. Robinson J A. A machine-oriented logic based on the resolution principle.Journal of the ACM, 1965, 12: 23–41.

    Article  MATH  Google Scholar 

  26. Clowes M B. On seeing things.Artificial Intelligence, 1971, 2: 79–116.

    Article  Google Scholar 

  27. Gu J. Parallel algorithms and architectures for very fast search. Technical Report UUCS-TR-88-005, Jul. 1988.

  28. Huffman D A. Impossible Objects as Nonsense Sentences. InMachine Intelligence, Meltzer B, Michie D (eds.), 1971, pp. 295–323. Edinburgh University Press, Edinburgh, Scotland.

    Google Scholar 

  29. Waltz D. Generating semantic descriptions from drawings of scenes with shadows. Technical Report AI271, MIT, Nov. 1972.

  30. Davis M, Logemann G, Loveland D. A machine program for theorem proving.Communications of the ACM, 1962, 5: 394–397.

    Article  MATH  MathSciNet  Google Scholar 

  31. Loveland D W. Automated Theorem Proving: A Logical Basis. North-Holland, 1978.

  32. Gu J, Wang W. A novel discrete relaxation architecture.IEEE Trans. Pattern Analysis and Machine Intelligence, Aug. 1992, 14(8): 857–865.

    Article  Google Scholar 

  33. Gu J, Wang W, Henderson T C. A parallel architecture for discrete relaxation algorithm.IEEE Trans. Pattern Analysis and Machine Intelligence, Nov. 1987, PAMI-9(6): 816–831.

    Article  Google Scholar 

  34. Jeroslow R E, Wang J. Solving propositional satisfiability problems.Annals of Mathematics and AI, 1990, 1: 167–187.

    MATH  Google Scholar 

  35. Gu J. Local search for satisfiability (SAT) problem.IEEE Trans. Systems, Man, and Cybernetics, Jul. 1993, 23(4): 1108–1129, Apr. 1994, 24(4): 709.

    Article  Google Scholar 

  36. Purdom P W, Haven G N. Backtracking and probing. Technical Report No. 387, Dept. of Computer Science, Indiana University, Aug. 1993.

  37. Bohm M, Speckenmeyer E. A fast parallel SAT-solver — Efficient workload balancing. Presented at the 3rd International Symposium on AI&Mathematics, Jan. 1994.

  38. Truemper K. Polynomial algorithms for problems over d-systems. Presented at the 3rd International Symposium on AI & Mathematics, Jan. 1994.

  39. Dubois O, Andre P, Boufkhad Y, Carlier J. SAT versus UNSAT.DIMACS Series Volume: Clique, Graph Coloring, and Satisfiability — Second DIMACS Implementation Challenge, Johnson D S, Trick M A (eds.), 26, American Mathematical Society, 1996.

  40. Sosič R, Gu J. How to search for million queens. Technical Report UUCS-TR-88-008, Feb. 1988.

  41. Sosič R, Gu J. Quickn-queen search on VAX and Bobcat machines. CS 547 AI Class Project, Feb. 1988.

  42. Sosič R, Gu J, Johnson R. The Unison algorithm: Fast evaluation of Boolean expressions.ACM Transactions on Design Automation of Electronic Systems, Oct. 1996, 1(4): 456–477.

    Article  Google Scholar 

  43. Sosič R, Gu J, Johnson R. A universal Boolean evaluator.IEEE Trans. Computers, accepted for publication in 1992.

  44. Papadimitriou C H. Private Communications, 1992.

  45. Papadimitriou C H. On selecting a satisfying truth assignment. InProceedings of the 32nd Annual Symposium of the Foundations of Computer Science, 1991, pp. 163–169.

  46. Selman B, Levesque H, Mitchell D. A new method for solving hard satisfiability problem. InProceedings of AAAI'92, Jul. 1992, pp. 440–446.

  47. Blair C E, Jeroslow R G, Lowe J K. Some results and experiments in programming techniques for propositional logic.Computers and Operations Research, 1986, 5: 633–645.

    Article  MathSciNet  Google Scholar 

  48. Jeroslow R G. Computation-oriented reductions of predicate to propositional logic.Decision Support Systems, 1988, 4: 183–197.

    Article  Google Scholar 

  49. Hooker J N. Generalized resolution and cutting planes.Annals of Operations Research, 1988, 12: 217–239.

    Article  MathSciNet  Google Scholar 

  50. Hooker J N. Resolution vs. cutting plane solution of inference problems: Some computational experience.Operations Research Letter, 1988, 7(1): 1–7.

    Article  MATH  MathSciNet  Google Scholar 

  51. Hooker J N, Fedjki C. Branch-and-cut solution of inference problems in propositional logic. Technical Report 77-88-89, GSIA, Carnegie Mellon University, Aug. 1989.

  52. Kamath A P, Karmarkar N K, Ramakrishnan K G, Resende M G C. Computational experience with an interior point algorithm on the satisfiability problem.Annals of Operations Research, 1990, 25: 43–58.

    Article  MATH  MathSciNet  Google Scholar 

  53. Kamath A P, Karmarkar N K, Ramakrishnan K G, Resende M G C. Computational experience with an interior point algorithm on the satisbility problem.Mathematical Sciences Research Center, AT&T Bell Laboratories, Oct. 1989.

  54. Gu J. TheUniSAT problem models (appendix).IEEE Trans. Pattern Analysis and Machine Intelligence, Aug. 1992, 14(8): 865.

    Article  Google Scholar 

  55. Johnson J L. A neural network approach to the 3-satisfiability problem.J. Parallel and Distributed Computing, 1989, 6: 435–449.

    Article  Google Scholar 

  56. Chakradhar S, Agrawal V, Bushnell M. Neural net and Boolean satisfiability model of logic circuits.IEEE Design & Test of Computers, Oct. 1990, pp.54–57.

  57. Genesereth M R, Nilsson N J. Logical Foundations of Artificial Intelligence. Morgan, Kaufmann Publishers, Los Altos, California, 1987.

    MATH  Google Scholar 

  58. Tseitin G S. On the Complexity of Derivations in Propositional Calculus. InStructures in Constructive Mathematics and Mathematical Logic, Part II, Slisenko A O (ed.), 1968, pp. 115–125.

  59. Urquhart A. The complexity of propositional proofs.The Bulletin of Symbolic Logic, 1995, 1(4): 425–467.

    Article  MATH  MathSciNet  Google Scholar 

  60. Iwama K. CNF satisfiability test by counting and polynomial average time.SIAM J. Computing, 1989, 18: 385–391.

    Article  MATH  MathSciNet  Google Scholar 

  61. Galil Z. On the complexity of regular resolution and the Davis-Putnam procedure.Theoretical Computer Science, 1977, pp. 23–46.

  62. Goldberg A, Purdom P W, Brown C A. Average time analysis of simplified Davis-Putnam procedures.Information Processing Letters, Sept. 1982, 15(2): 72–75.

    Article  MATH  MathSciNet  Google Scholar 

  63. Purdom P W, Brown C A. The pure literal rule and polynomial average time.SIAM J. Computing, 1985, 14: 943–953.

    Article  MATH  MathSciNet  Google Scholar 

  64. Hu T H, Tang C Y, Lee R C T. An average case analysis of a resolution principle algorithm in mechanical theorem proving.Annals of Mathematics and Artificial Intelligence, 1992, 6: 235–252.

    Article  MATH  MathSciNet  Google Scholar 

  65. Gilmore P C. A proof method for quantification theory,IBM J. Res. Develop. 1960, 4: 28–35.

    Article  MATH  MathSciNet  Google Scholar 

  66. Aho A V, Hopcroft J E, Ullman J D. The Design and Analysis of Computer Algorithms. Addison-Wesley, Reading, 1974.

    MATH  Google Scholar 

  67. Cook S A. The complexity of theorem-proving procedures. InProceedings of the Third ACM Symposium on Theory of Computing, 1971, pp. 151–158.

  68. Aspvall B, Plass M F, Tarjan R E. A linear-time algorithm for testing the truth of certain quantified Boolean formulas.Information Processing Letters, Mar. 1979, 8(3): 121–132.

    Article  MATH  MathSciNet  Google Scholar 

  69. Even S, Itai A, Shamir A. On the complexity of timetable and multi-commodity flow problem.SIAM J. Computing, 1976, 5(4): 691–703.

    Article  MATH  MathSciNet  Google Scholar 

  70. Schaefer T J. The complexity of satisfiability problem. InProceedings of the 10th ACM Symposium on Theory of Computing, 1978, pp. 216–226.

  71. Hooker J N. A quantitative approach to logical inference.Decision Support Systems, 1988, 4: 45–69.

    Article  Google Scholar 

  72. Papadimitriou C H, Steiglitz K. Combinatorial Optimization: Algorithms and Complexity. Prentice Hall, Englewood Cliffs, 1982.

    MATH  Google Scholar 

  73. Williams H P. Linear and integer programming applied to the propositional calculus.Systems Research and Information Sciences, 1987, 2: 81–100.

    Google Scholar 

  74. Shi R C-J, Vannelli A, Vlach J. An improvement on Karmarkar's algorithm for integer programming.COAL Bulletin of the Mathematical Programming Society, 1992.

  75. Tyler J E. Parallel computer architectures and problem solving strategies for the consistent labeling problem. Master's thesis, Dept. of Elec. Eng., Virginia Polytech. Inst. State Univ., Blacksburg, Virginia, Oct. 1983.

    Google Scholar 

  76. McCall J T, Tront J G, Gray F G, Haralick R M, McCormack W M. Parallel computer architectures and problem solving strategies for the consistent labeling problem.IEEE Trans. Computers, Nov. 1985, C-34(11): 973–980.

    Article  Google Scholar 

  77. Samal A, Henderson T C. Parallel consistent labeling algorithms.International Journal of Parallel Programming, 1988.

  78. Chen W T, Liu L L. Parallel approach for theorem proving in propositional logic.Inform. Sci., 1987, 41(1): 61–76.

    Article  MATH  MathSciNet  Google Scholar 

  79. Fang M Y, Chen W T. Vectorization of a generalized procedure for theorem proving in propositional logic on vector computers.IEEE Trans. Knowledge and Data Engineering, Oct. 1992, 4(5): 475–486.

    Article  Google Scholar 

  80. Conery J S. Parallel Execution of Logic Programs. Kluwer Academic Publishers, Boston, 1987.

    Google Scholar 

  81. Lin Y J. A Parallel Implementation of Logic Programs. PhD thesis, The Univ. of Texas at Austin, Dept. of Computer Science, May 1988.

  82. Wah B, Li G J Computers for Artificial Intelligence Applications. IEEE Computer Society Press, Washington D. C., 1986.

    Google Scholar 

  83. Wah B W (ed.). New computers for artificial intelligence processing.IEEE Computer 1987, 20(1), IEEE Computer Society Press, 1987.

  84. Wah B W, Lowrie M B, Li G J. Computers for symbolic processing. InProceedings of the IEEE, Apr. 1989, 77(4): 509–540.

  85. Sosič R, Gu J. A parallel local search algorithm for satisfiability (SAT) problem. Submitted for publication, 1993.

  86. Gu J. An αβ-relaxation for global optimization. Technical Report UCECE-TR-91-003, Apr. 1991.

  87. Garey M R, Johnson D S. Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman and Company, San Francisco, 1979.

    MATH  Google Scholar 

  88. Luenberger D G. Linear and Nonlinear Programming. Addison-Wesley, Reading, 1984.

    MATH  Google Scholar 

  89. Du Dingzhu. Convergence Theory of Feasible Direction Methods. Science Press, 1991.

  90. Strang G. Linear Algebra and Its Applications. Academic Press, New York, 1976.

    MATH  Google Scholar 

  91. Chvátal V, Szemerédi E. Many hard examples for resolution.J. ACM, 1988, 35: 759–770.

    Article  MATH  Google Scholar 

  92. Franco J. Elimination of infrequent variables improves average case performance of satisfiability algorithms.SIAM J. Computing, 1991, 20: 1119–1127.

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, University of Calgary, T2N 1N4, Calgary, Canada

    Gu Jun

  2. Department of Computer Science, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong

    Gu Jun

  3. Department of Computer Software, The University of Aizu, Aizu-Wakamatsu, 965-80, Fukushima, Japan

    Gu Qianping

  4. Department of Computer Science, University of Minnesota, 55455, Minneapolis, MN, U.S.A.

    Du Dingzhu

Authors
  1. Gu Jun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gu Qianping
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Du Dingzhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gu Jun.

Additional information

This work was supported in part by NSERC Strategic Grant MEF0045793 and NSERC Research Grant OGP0046423.

A part of an early version of this paper was published in IEEE Transactions on Computers, Vol. 45, No. 2, 1996.

For the biography ofGU Jun, please refer to p. 90 of this issue.

GU Qianping received the B.S. degree from Shandong University, China, M.S. degree from Ibaraki University, Japan, and Ph.D. degree from Tohoku University, Japan, all in computer science, in 1982, 1985, and 1988, respectively. He is currently an Associate Professor in the Department of Computer Software, the University of Aizu, Japan. He was with the Institute of Software, Chinese Academy of Sciences, Beijing, China, and the Department of Electrical and Computer Engineering, the University of Calgary, Canada. His research interests include algorithms, computational complexity, machine learning, parallel processing, and optimization. He is a member of ACM, IEEE Computer Society, and IEICE of Japan.

DU Dingzhu received his M.S. degree in 1982 from the Institute of Applied Mathematics, Chinese Academy of Sciences, and his Ph.D. degree in Computer Science in 1985 from the University of California at Santa Barbara. He visited MSRI in 1985, MIT in 1986, and Princeton University in 1990. Currently he is a tenure faculty at the Department of Computer Science, University of Minnesota, and a research Professor at the Institute of Applied Mathematics, Chinese Academy of Sciences, Beijing. He has published eight books and over 100 journal papers. His research interests are computational complexity, analysis and design of algorithms, combinatorial optimization, computational geometry, communication networks, and linear and nonlinear programming. In 1986, with Xiangsun Zhang, he established the convergence of Rosen's gradient projection method and in 1990, with Frank Huang, he proved the Gilbert-Pollak conjecture on Steiner ratio.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gu, J., Gu, Q. & Du, D. On optimizing the satisfiability (SAT) problem. J. Comput. Sci. & Technol. 14, 1–17 (1999). https://doi.org/10.1007/BF02952482

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02952482

Keywords

Search

Navigation