Implement abstract pass and paddle compiler collection api. (#71119)

* abstract pass initial commit

* remove unused index_expr code

* Fix compiling error on CI.

* Change the log level.

* Rename ap_lower_fusion_op_pass to ap_generic_drr_pass.

* Rename ap_unary -> ap_variadic, ApUnary -> ApVariadic.

* Fallback to cinn when ap fails, and disable fuse_gemm_epilogue when ap is enabled.

* Fix compiling error in CI, including: using std::memcpy instead of reinterpret_cast to avoid strict-aliasing.

* Fix narrowing conversion error and unused value error.

* Fix missing-field-initializers and unused-result error on CI.

* Fix some sign-compare error on CI.

* Add cmake dependent.

* Fix some using statement without creating an alias.

* Support experimental/type_traits for WIN32.

* Fix an unused-but-set-parameter and remove the `typename` in using statement added by previous commit.

* Disable AP when cinn is not enabled.

* Remove the use of Reciprocal because Reciprocal is deleted by #70376.

* Fix "basic_string::_M_construct null not valid" error.

* Fix typo.

* Support meticulous matching (with input/outoput number). Submit by hxzd5568.

* remove redundant sentence

* Using void* as StreamT.

* Fix compiling error related to std::optional<StreamT> on gcc12.

* support no-extra-use for temporary ir value in source pattern

* minor fix

* minor fix

* Return the address of stream instead.

* support paddle.cc.*

* fix adt::WeakPtrLock bug

* rename all non python standard api's to __builtin__xxx

* move paddle.cc into paddle.incubate.cc

* Add pcc to setup.py.

* Add missing modules and return partial_program_layer directly in pcc.compile.

* Fix the mismatched output  numerical order issue

* Remove force_register_fusion related codes in pcc api.

* Add an argument train.

* Add pcc to setup.py.

---------

Co-authored-by: Liu Yiqun <liuyiqun01@baidu.com>
Co-authored-by: hxzd5568 <3257591325@qq.com>

Author: 3 people

paddle/CMakeLists.txt

@@ -5,6 +5,9 @@ set(PYTHON_TESTS_DIR
 add_subdirectory(utils)
 add_subdirectory(common)
 add_subdirectory(pir)
+if(WITH_CINN)
+  add_subdirectory(ap)
+endif()
 add_subdirectory(scripts)
 add_subdirectory(testing)
 add_subdirectory(phi)

paddle/ap/CMakeLists.txt

@@ -0,0 +1,67 @@
+set(AP_COMMON_DEPS absl)
+if(WITH_ONEDNN)
+  list(APPEND AP_COMMON_DEPS onednn)
+endif()
+
+file(GLOB_RECURSE axpr_srcs "src/axpr/*.cc")
+set(axpr_deps common)
+cc_library(
+  axpr
+  SRCS ${axpr_srcs}
+  DEPS ${AP_COMMON_DEPS} ${axpr_deps})
+
+file(GLOB_RECURSE ap_drr_srcs "src/drr/*.cc")
+set(ap_drr_deps axpr)
+cc_library(
+  ap_drr
+  SRCS ${ap_drr_srcs}
+  DEPS ${AP_COMMON_DEPS} ${ap_drr_deps})
+
+file(GLOB_RECURSE ap_code_module_srcs "src/code_module/*.cc")
+set(ap_code_module_deps axpr)
+cc_library(
+  ap_code_module
+  SRCS ${ap_code_module_srcs}
+  DEPS ${AP_COMMON_DEPS} ${ap_code_module_deps})
+
+file(GLOB_RECURSE ap_code_gen_srcs "src/code_gen/*.cc")
+set(ap_code_gen_deps axpr ap_code_module)
+cc_library(
+  ap_code_gen
+  SRCS ${ap_code_gen_srcs}
+  DEPS ${AP_COMMON_DEPS} ${ap_code_gen_deps})
+
+file(GLOB_RECURSE ap_kernel_dispatch_srcs "src/kernel_dispatch/*.cc")
+set(ap_kernel_dispatch_deps axpr ap_code_module ap_code_gen)
+cc_library(
+  ap_kernel_dispatch
+  SRCS ${ap_kernel_dispatch_srcs}
+  DEPS ${AP_COMMON_DEPS} ${ap_kernel_dispatch_deps})
+
+file(GLOB_RECURSE ap_phi_srcs "src/paddle/phi/*.cc")
+set(ap_phi_deps axpr ap_code_module ap_code_gen ap_kernel_dispatch)
+cc_library(
+  ap_phi
+  SRCS ${ap_phi_srcs}
+  DEPS ${AP_COMMON_DEPS} ${ap_phi_deps})
+
+file(GLOB_RECURSE ap_pir_srcs "src/paddle/pir/*.cc")
+set(ap_pir_deps axpr ap_drr)
+cc_library(
+  ap_pir
+  SRCS ${ap_pir_srcs}
+  DEPS ${AP_COMMON_DEPS} ${ap_pir_deps})
+
+file(GLOB_RECURSE ap_reified_drr_srcs "src/reified_drr/*.cc")
+set(ap_reified_drr_deps axpr ap_drr ap_code_module ap_code_gen)
+cc_library(
+  ap_reified_drr
+  SRCS ${ap_reified_drr_srcs}
+  DEPS ${AP_COMMON_DEPS} ${ap_reified_drr_deps})
+
+file(GLOB_RECURSE ap_pass_srcs "src/paddle/pass/*.cc")
+set(ap_pass_deps axpr ap_pir ap_drr ap_code_module ap_code_gen ap_reified_drr)
+cc_library(
+  ap_pass
+  SRCS ${ap_pass_srcs}
+  DEPS ${AP_COMMON_DEPS} ${ap_pass_deps})