Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add documentation generate script for fluid #8004

Merged
merged 1 commit into from
Jan 31, 2018
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 9 additions & 4 deletions doc/api/v2/fluid/data_feeder.rst
Original file line number Diff line number Diff line change
@@ -1,9 +1,14 @@
.. THIS FILE IS GENERATED BY `gen_doc.{py|sh}`
!DO NOT EDIT THIS FILE MANUALLY!

===========
DataFeeder
data_feeder
===========

DataFeeder
-----------
.. automodule:: paddle.v2.fluid.data_feeder
:members: DataFeeder
----------

.. autoclass:: paddle.v2.fluid.data_feeder.DataFeeder
:members:
:noindex:

28 changes: 20 additions & 8 deletions doc/api/v2/fluid/evaluator.rst
Original file line number Diff line number Diff line change
@@ -1,9 +1,21 @@
===========
Evaluator
===========

Evaluator
-----------
.. automodule:: paddle.v2.fluid.evaluator
:members: Evaluator
.. THIS FILE IS GENERATED BY `gen_doc.{py|sh}`
!DO NOT EDIT THIS FILE MANUALLY!

=========
evaluator
=========

Accuracy
--------

.. autoclass:: paddle.v2.fluid.evaluator.Accuracy
:members:
:noindex:

ChunkEvaluator
--------------

.. autoclass:: paddle.v2.fluid.evaluator.ChunkEvaluator
:members:
:noindex:

33 changes: 28 additions & 5 deletions doc/api/v2/fluid/executor.rst
Original file line number Diff line number Diff line change
@@ -1,9 +1,32 @@
===========
Executor
===========
.. THIS FILE IS GENERATED BY `gen_doc.{py|sh}`
!DO NOT EDIT THIS FILE MANUALLY!

========
executor
========

Executor
--------

.. autoclass:: paddle.v2.fluid.executor.Executor
:members:
:noindex:

global_scope
------------

.. autofunction:: paddle.v2.fluid.executor.global_scope
:noindex:

scope_guard
-----------
.. automodule:: paddle.v2.fluid.executor
:members: Executor

.. autofunction:: paddle.v2.fluid.executor.scope_guard
:noindex:

switch_scope
------------

.. autofunction:: paddle.v2.fluid.executor.switch_scope
:noindex:

109 changes: 109 additions & 0 deletions doc/api/v2/fluid/gen_doc.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,109 @@
# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

from __future__ import print_function
import argparse
import sys
import types

import paddle.v2.fluid as fluid


def parse_arg():
parser = argparse.ArgumentParser()
parser.add_argument('--submodules', nargs="*")
parser.add_argument(
'module', type=str, help='Generate the documentation of which module')
return parser.parse_args()


class DocGenerator(object):
def __init__(self, module_name, stream=sys.stdout):
self.stream = stream
self.module_name = module_name
if not hasattr(fluid, module_name):
raise ValueError("Cannot find fluid.{0}".format(module_name))
else:
self.module = getattr(fluid, module_name)
self.stream.write('''.. THIS FILE IS GENERATED BY `gen_doc.{py|sh}`
!DO NOT EDIT THIS FILE MANUALLY!

''')

self._print_header_(module_name, dot='=', is_title=True)

def print_submodule(self, submodule_name):
submodule = getattr(self.module, submodule_name)
if submodule is None:
raise ValueError("Cannot find submodule {0}".format(submodule_name))
self.print_section(submodule_name)

for item in submodule.__all__:
self.print_item(item)

def print_current_module(self):
for item in self.module.__all__:
self.print_item(item)

def print_section(self, name):
self._print_header_(name, dot='=', is_title=False)

def print_item(self, name):
item = getattr(self.module, name)
if isinstance(item, types.TypeType):
self.print_class(name)
elif isinstance(item, types.FunctionType):
self.print_method(name)
else:
raise RuntimeError("Unsupported item {0}".format(name))

def print_class(self, name):
self._print_header_(name, dot='-', is_title=False)
self.stream.write('''.. autoclass:: paddle.v2.fluid.{0}.{1}
:members:
:noindex:

'''.format(self.module_name, name))

def print_method(self, name):
self._print_header_(name, dot='-', is_title=False)
self.stream.write('''.. autofunction:: paddle.v2.fluid.{0}.{1}
:noindex:

'''.format(self.module_name, name))

def _print_header_(self, name, dot, is_title):
dot_line = dot * len(name)
if is_title:
self.stream.write(dot_line)
self.stream.write('\n')
self.stream.write(name)
self.stream.write('\n')
self.stream.write(dot_line)
self.stream.write('\n')
self.stream.write('\n')


def main():
args = parse_arg()
gen = DocGenerator(args.module)
if args.submodules is None:
gen.print_current_module()
else:
for submodule_name in args.submodules:
gen.print_submodule(submodule_name)


if __name__ == '__main__':
main()
7 changes: 7 additions & 0 deletions doc/api/v2/fluid/gen_doc.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
#!/bin/bash
python gen_doc.py layers --submodules control_flow device io nn ops tensor > layers.rst

for module in io data_feeder evaluator executor initializer io nets optimizer param_attr profiler regularizer
do
python gen_doc.py ${module} > ${module}.rst
done
55 changes: 20 additions & 35 deletions doc/api/v2/fluid/initializer.rst
Original file line number Diff line number Diff line change
@@ -1,50 +1,35 @@
.. THIS FILE IS GENERATED BY `gen_doc.{py|sh}`
!DO NOT EDIT THIS FILE MANUALLY!

===========
Initializer
initializer
===========

Constant
--------


Initializer
-----------
.. automodule:: paddle.v2.fluid.initializer
:members: Initializer
:noindex:



ConstantInitializer
-------------------
.. automodule:: paddle.v2.fluid.initializer
:members: ConstantInitializer
.. autoclass:: paddle.v2.fluid.initializer.Constant
:members:
:noindex:

Uniform
-------


UniformInitializer
------------------
.. automodule:: paddle.v2.fluid.initializer
:members: UniformInitializer
:noindex:



NormalInitializer
-----------------
.. automodule:: paddle.v2.fluid.initializer
:members: NormalInitializer
.. autoclass:: paddle.v2.fluid.initializer.Uniform
:members:
:noindex:

Normal
------

XavierInitializer
-----------------
.. automodule:: paddle.v2.fluid.initializer
:members: XavierInitializer
.. autoclass:: paddle.v2.fluid.initializer.Normal
:members:
:noindex:

Xavier
------

MSRAInitializer
---------------
.. automodule:: paddle.v2.fluid.initializer
:members: MSRAInitializer
.. autoclass:: paddle.v2.fluid.initializer.Xavier
:members:
:noindex:

61 changes: 56 additions & 5 deletions doc/api/v2/fluid/io.rst
Original file line number Diff line number Diff line change
@@ -1,10 +1,61 @@
===========
IO
===========
.. THIS FILE IS GENERATED BY `gen_doc.{py|sh}`
!DO NOT EDIT THIS FILE MANUALLY!

==
io
==

save_vars
---------

is_parameter
.. autofunction:: paddle.v2.fluid.io.save_vars
:noindex:

save_params
-----------
.. autofunction:: paddle.v2.fluid.io.is_parameter

.. autofunction:: paddle.v2.fluid.io.save_params
:noindex:

save_persistables
-----------------

.. autofunction:: paddle.v2.fluid.io.save_persistables
:noindex:

load_vars
---------

.. autofunction:: paddle.v2.fluid.io.load_vars
:noindex:

load_params
-----------

.. autofunction:: paddle.v2.fluid.io.load_params
:noindex:

load_persistables
-----------------

.. autofunction:: paddle.v2.fluid.io.load_persistables
:noindex:

save_inference_model
--------------------

.. autofunction:: paddle.v2.fluid.io.save_inference_model
:noindex:

load_inference_model
--------------------

.. autofunction:: paddle.v2.fluid.io.load_inference_model
:noindex:

get_inference_program
---------------------

.. autofunction:: paddle.v2.fluid.io.get_inference_program
:noindex:

Loading