Lab 4, Grafana issue with yardstick test opnfv_yardstick_tc001.yaml

EDDROPI135

Dear LFS264 community,

I am facing the problem that the test results for the tests "opnfv_yardstick_tc001.yaml" are not shown in the Grafana Dashboard (i.e. the graphs does not show any results). I followed the instructions and started the tests which seem be executed successfully. However, when looking at the Grafana Dashboard, there are no graphs displayed. On the terminal, I get the a log sequence (see below) that complains about a Runtime error pointing to the dispatcher type. Strangely, the dispatcher type is misspelled in the log (it should all be "wizardly_gates" instead of "Wizardly_gates").

Could you please help me find the reason for this issue?

Please find also below the file content for "/etc/yardstick/yardstick.conf" and printout of docker ps and network inspect bridge commands

[DEFAULT]

debug = False

dispatcher = wizardly_gates

[dispatcher_http]

timeout = 5

target = http://127.0.0.1:8000/results

[dispatcher_file]

file_path = /tmp/yardstick.out

max_bytes = 0

backup_count = 0…

[dispatcher_influxdb]

timeout = 5

target = http://172.17.0.3:8086

db_name = yardstick

username = root

password = root

docker ps

CONTAINER ID        IMAGE                         COMMAND                  CREATED              STATUS              PORTS                                     

      NAMES

077b7fd0a280        grafana/grafana:4.4.3         "/run.sh"                44 seconds ago       Up 43 seconds       0.0.0.0:1948->3000/tcp                    

      musing_shaw

ad0cceb9d22f        tutum/influxdb:0.13           "/run.sh"                About a minute ago   Up About a minute   0.0.0.0:8083->8083/tcp, 0.0.0.0:8086-

>8086/tcp   wizardly_gates

e3950b56e7af        opnfv/yardstick:opnfv-5.1.0   "/usr/bin/supervisord"   2 hours ago          Up 2 hours          0.0.0.0:8888->5000/tcp                    

      yardstick

docker network inspect bridge

[

    {

        "Name": "bridge",

        "Id": "c4dfb321d745b024ad255eaf0181bfac8fa15ae26a13f610dbfaac6e8158a777",

        "Created": "2018-08-01T07:28:53.876506705Z",

        "Scope": "local",

        "Driver": "bridge",

        "EnableIPv6": false,

        "IPAM": {

            "Driver": "default",

            "Options": null,

            "Config": [

                {

                    "Subnet": "172.17.0.0/16",

                    "Gateway": "172.17.0.1"

                }

            ]

        },

        "Internal": false,

        "Attachable": false,

        "Ingress": false,

        "ConfigFrom": {

            "Network": ""

        },

        "ConfigOnly": false,

        "Containers": {

            "077b7fd0a280e221041ebc1159cb9f3da3ff78d1a837dcca8218491038bf2c5c": {

                "Name": "musing_shaw",

                "EndpointID": "64f7f91ce734b4a7aa2a860cf66029b96606ee658e8baea386354c7ca9a9d77c",

                "MacAddress": "02:42:ac:11:00:04",

                "IPv4Address": "172.17.0.4/16",

                "IPv6Address": ""

            },

            "ad0cceb9d22f97b4e13059a3efcee97e7fcf44875a1c283822e5dcb67ab143a6": {

                "Name": "wizardly_gates",

                "EndpointID": "6b3ecdf2b846fad608bcc6f5afbeedeefec18db7471b5c65e3b6968f1c1ef894",

                "MacAddress": "02:42:ac:11:00:03",

                "IPv4Address": "172.17.0.3/16",

                "IPv6Address": ""

            },

            "e3950b56e7af5ed00126305db43d38c627da3b4201299c86bf04859b041add8e": {

                "Name": "yardstick",

                "EndpointID": "9540da5232682df4a8eedcc552d29c0df2d857db84c7e061dcd1b1eb129e1e7d",

                "MacAddress": "02:42:ac:11:00:02",

                "IPv4Address": "172.17.0.2/16",

                "IPv6Address": ""

            }

        },

        "Options": {

            "com.docker.network.bridge.default_bridge": "true",

            "com.docker.network.bridge.enable_icc": "true",

            "com.docker.network.bridge.enable_ip_masquerade": "true",

            "com.docker.network.bridge.host_binding_ipv4": "0.0.0.0",

            "com.docker.network.bridge.name": "docker0",

            "com.docker.network.driver.mtu": "1500"

        },

        "Labels": {}

    }

]

========================

LOG file

========================

 

]0;root@e3950b56e7af: /home/opnfv/repos/yardstickroot@e3950b56e7af:/home/opnfv/repos/yardstick# yardstick task start

tests/opnfv/test_cases/opnfv_yardstick_tc001.yaml

No handlers could be found for logger "yardstick.common.utils"

/usr/local/lib/python2.7/dist-packages/flask/exthook.py:71: ExtDeprecationWarning: Importing flask.ext.restful is deprecated, use flask_restful instead.

  .format(x=modname), ExtDeprecationWarning

2018-08-01 11:39:35,032 [INFO] yardstick.cmd.commands.task task.py:54 Task START

2018-08-01 11:39:35,034 [INFO] yardstick.benchmark.core.task task.py:483 Parsing task config: tests/opnfv/test_cases/opnfv_yardstick_tc001.yaml

Writing /home/opnfv/repos/yardstick/yardstick/resources/files/yardstick_key-5f1b37cd ...

2018-08-01 11:39:35,195 [INFO] yardstick.benchmark.contexts.heat heat.py:303 Deploying context 'yardstick-d3b10d7f' START

2018-08-01 11:39:35,197 [INFO] yardstick.orchestrator.heat heat.py:616 Creating stack 'yardstick-d3b10d7f' START

2018-08-01 11:41:29,571 [INFO] yardstick.orchestrator.heat heat.py:649 Creating stack 'yardstick-d3b10d7f' DONE in 109 secs

2018-08-01 11:41:30,527 [INFO] yardstick.benchmark.contexts.heat heat.py:333 Deploying context 'yardstick-d3b10d7f' DONE

2018-08-01 11:41:30,534 [INFO] yardstick.benchmark.core.task task.py:373 Starting runner of type 'Iteration'

2018-08-01 11:41:30,541 [INFO] yardstick.benchmark.runners.iteration iteration.py:51 worker START, iterations 2 times, class <class

'yardstick.benchmark.scenarios.networking.pktgen.Pktgen'>

2018-08-01 11:41:30,542 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:67 user:ubuntu, target:192.168.37.202

2018-08-01 11:49:46,944 [ERROR] paramiko.transport transport.py:1567 Exception: Error reading SSH protocol banner

2018-08-01 11:49:46,946 [ERROR] paramiko.transport transport.py:1565 Traceback (most recent call last):

2018-08-01 11:49:46,946 [ERROR] paramiko.transport transport.py:1565   File "/usr/local/lib/python2.7/dist-packages/paramiko/transport.py", line 1744, in run

2018-08-01 11:49:46,946 [ERROR] paramiko.transport transport.py:1565     self._check_banner()

2018-08-01 11:49:46,946 [ERROR] paramiko.transport transport.py:1565   File "/usr/local/lib/python2.7/dist-packages/paramiko/transport.py", line 1892, in

_check_banner

2018-08-01 11:49:46,947 [ERROR] paramiko.transport transport.py:1565     raise SSHException('Error reading SSH protocol banner' + str(e))

2018-08-01 11:49:46,947 [ERROR] paramiko.transport transport.py:1565 SSHException: Error reading SSH protocol banner

2018-08-01 11:49:46,947 [ERROR] paramiko.transport transport.py:1565

2018-08-01 11:49:49,063 [ERROR] paramiko.transport transport.py:1567 Exception: Error reading SSH protocol banner

2018-08-01 11:49:49,063 [ERROR] paramiko.transport transport.py:1565 Traceback (most recent call last):

2018-08-01 11:49:49,063 [ERROR] paramiko.transport transport.py:1565   File "/usr/local/lib/python2.7/dist-packages/paramiko/transport.py", line 1744, in run

2018-08-01 11:49:49,063 [ERROR] paramiko.transport transport.py:1565     self._check_banner()

2018-08-01 11:49:49,063 [ERROR] paramiko.transport transport.py:1565   File "/usr/local/lib/python2.7/dist-packages/paramiko/transport.py", line 1892, in

_check_banner

2018-08-01 11:49:49,063 [ERROR] paramiko.transport transport.py:1565     raise SSHException('Error reading SSH protocol banner' + str(e))

2018-08-01 11:49:49,064 [ERROR] paramiko.transport transport.py:1565 SSHException: Error reading SSH protocol banner

2018-08-01 11:49:49,064 [ERROR] paramiko.transport transport.py:1565

2018-08-01 11:49:53,549 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:71 user:ubuntu, host:192.168.37.203

2018-08-01 11:50:28,139 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 19777 > sla_max_ppm 1000; ',)

2018-08-01 11:50:53,713 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 47066 > sla_max_ppm 1000; ',)

2018-08-01 11:50:54,714 [INFO] yardstick.benchmark.runners.iteration iteration.py:121 worker END

2018-08-01 11:50:54,880 [INFO] yardstick.benchmark.core.task task.py:279 Runner ended, output in /tmp/yardstick.out

2018-08-01 11:50:54,883 [INFO] yardstick.benchmark.core.task task.py:373 Starting runner of type 'Iteration'

2018-08-01 11:50:54,889 [INFO] yardstick.benchmark.runners.iteration iteration.py:51 worker START, iterations 2 times, class <class

'yardstick.benchmark.scenarios.networking.pktgen.Pktgen'>

2018-08-01 11:50:54,891 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:67 user:ubuntu, target:192.168.37.202

2018-08-01 11:50:56,553 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:71 user:ubuntu, host:192.168.37.203

2018-08-01 11:51:24,671 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 7684 > sla_max_ppm 1000; ',)

2018-08-01 11:51:49,685 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 4116 > sla_max_ppm 1000; ',)

2018-08-01 11:51:50,687 [INFO] yardstick.benchmark.runners.iteration iteration.py:121 worker END

2018-08-01 11:51:50,961 [INFO] yardstick.benchmark.core.task task.py:279 Runner ended, output in /tmp/yardstick.out

2018-08-01 11:51:50,963 [INFO] yardstick.benchmark.core.task task.py:373 Starting runner of type 'Iteration'

2018-08-01 11:51:50,971 [INFO] yardstick.benchmark.runners.iteration iteration.py:51 worker START, iterations 2 times, class <class

'yardstick.benchmark.scenarios.networking.pktgen.Pktgen'>

2018-08-01 11:51:50,972 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:67 user:ubuntu, target:192.168.37.202

2018-08-01 11:51:52,141 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:71 user:ubuntu, host:192.168.37.203

2018-08-01 11:52:20,176 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 3146 > sla_max_ppm 1000; ',)

2018-08-01 11:52:45,213 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 6207 > sla_max_ppm 1000; ',)

2018-08-01 11:52:46,215 [INFO] yardstick.benchmark.runners.iteration iteration.py:121 worker END

2018-08-01 11:52:46,391 [INFO] yardstick.benchmark.core.task task.py:279 Runner ended, output in /tmp/yardstick.out

2018-08-01 11:52:46,393 [INFO] yardstick.benchmark.core.task task.py:373 Starting runner of type 'Iteration'

2018-08-01 11:52:46,399 [INFO] yardstick.benchmark.runners.iteration iteration.py:51 worker START, iterations 2 times, class <class

'yardstick.benchmark.scenarios.networking.pktgen.Pktgen'>

2018-08-01 11:52:46,401 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:67 user:ubuntu, target:192.168.37.202

2018-08-01 11:52:47,418 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:71 user:ubuntu, host:192.168.37.203

2018-08-01 11:53:15,319 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 65928 > sla_max_ppm 1000; ',)

2018-08-01 11:53:40,350 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 3202 > sla_max_ppm 1000; ',)

2018-08-01 11:53:41,351 [INFO] yardstick.benchmark.runners.iteration iteration.py:121 worker END

2018-08-01 11:53:41,518 [INFO] yardstick.benchmark.core.task task.py:279 Runner ended, output in /tmp/yardstick.out

2018-08-01 11:53:41,520 [INFO] yardstick.benchmark.core.task task.py:373 Starting runner of type 'Iteration'

2018-08-01 11:53:41,526 [INFO] yardstick.benchmark.runners.iteration iteration.py:51 worker START, iterations 2 times, class <class

'yardstick.benchmark.scenarios.networking.pktgen.Pktgen'>

2018-08-01 11:53:41,527 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:67 user:ubuntu, target:192.168.37.202

2018-08-01 11:53:42,438 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:71 user:ubuntu, host:192.168.37.203

2018-08-01 11:54:10,282 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 4962 > sla_max_ppm 1000; ',)

2018-08-01 11:54:35,222 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 4792 > sla_max_ppm 1000; ',)

2018-08-01 11:54:36,223 [INFO] yardstick.benchmark.runners.iteration iteration.py:121 worker END

2018-08-01 11:54:36,368 [INFO] yardstick.benchmark.core.task task.py:279 Runner ended, output in /tmp/yardstick.out

2018-08-01 11:54:36,370 [INFO] yardstick.benchmark.core.task task.py:373 Starting runner of type 'Iteration'

2018-08-01 11:54:36,376 [INFO] yardstick.benchmark.runners.iteration iteration.py:51 worker START, iterations 2 times, class <class

'yardstick.benchmark.scenarios.networking.pktgen.Pktgen'>

2018-08-01 11:54:36,377 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:67 user:ubuntu, target:192.168.37.202

2018-08-01 11:54:37,461 [INFO] yardstick.benchmark.scenarios.networking.pktgen pktgen.py:71 user:ubuntu, host:192.168.37.203

2018-08-01 11:55:05,349 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 3700 > sla_max_ppm 1000; ',)

2018-08-01 11:55:30,349 [WARNING] yardstick.benchmark.runners.iteration iteration.py:81 SLA validation failed: ('ppm 6399 > sla_max_ppm 1000; ',)

2018-08-01 11:55:31,351 [INFO] yardstick.benchmark.runners.iteration iteration.py:121 worker END

2018-08-01 11:55:31,596 [INFO] yardstick.benchmark.core.task task.py:279 Runner ended, output in /tmp/yardstick.out

2018-08-01 11:55:31,597 [INFO] yardstick.benchmark.core.task task.py:130 Testcase: "opnfv_yardstick_tc001" SUCCESS!!!

2018-08-01 11:55:31,597 [INFO] yardstick.benchmark.contexts.heat heat.py:386 Undeploying context 'yardstick-d3b10d7f' START

2018-08-01 11:55:31,597 [INFO] yardstick.orchestrator.heat heat.py:92 Deleting stack 'yardstick-d3b10d7f' START, uuid:e88cc5fb-537a-4362-9110-4b2a5808a0fb

2018-08-01 11:56:06,914 [INFO] yardstick.orchestrator.heat heat.py:108 Deleting stack 'yardstick-d3b10d7f' DONE in 29 secs

2018-08-01 11:56:06,915 [INFO] yardstick.benchmark.contexts.heat heat.py:389 Undeploying context 'yardstick-d3b10d7f' DONE

2018-08-01 11:56:06,915 [INFO] yardstick.benchmark.core.task task.py:143 Task tests/opnfv/test_cases/opnfv_yardstick_tc001.yaml finished in 991 secs

2018-08-01 11:56:06,916 [ERROR] yardstick.cmd.commands.task task.py:59

Traceback (most recent call last):

  File "/home/opnfv/repos/yardstick/yardstick/cmd/commands/task.py", line 56, in do_start

    result = Task().start(param, **kwargs)

  File "/home/opnfv/repos/yardstick/yardstick/benchmark/core/task.py", line 147, in start

    self._do_output(output_config, result)

  File "/home/opnfv/repos/yardstick/yardstick/benchmark/core/task.py", line 234, in _do_output

    dispatchers = DispatcherBase.get(output_config)

  File "/home/opnfv/repos/yardstick/yardstick/dispatcher/base.py", line 46, in get

    for out_type in config['DEFAULT']['dispatcher']]

  File "/home/opnfv/repos/yardstick/yardstick/dispatcher/base.py", line 38, in get_cls

    raise RuntimeError("No such dispatcher_type %s" % dispatcher_type)

RuntimeError: No such dispatcher_type Wizardly_gates

2018-08-01 11:56:06,950 [INFO] yardstick.cmd.commands.task task.py:64 Task FAILED

<type 'exceptions.RuntimeError'>

Python 2.7.6: /usr/bin/python

Wed Aug  1 11:56:06 2018

A problem occurred in a Python script.  Here is the sequence of

function calls leading up to the error, in the order they occurred.

 /usr/local/bin/yardstick in <module>()

    8 if __name__ == '__main__':

    9     sys.argv[0] = re.sub(r'(-script\.pyw?|\.exe)?$', '', sys.argv[0])

   10     sys.exit(

   11         load_entry_point('yardstick', 'console_scripts', 'yardstick')()

   12     )

load_entry_point = <function load_entry_point>

 /home/opnfv/repos/yardstick/yardstick/main.py in main()

   47 def main():

   48     """yardstick main"""

   49     YardstickCLI().main(sys.argv[1:])

   50

   51 if __name__ == '__main__':

global YardstickCLI = <class yardstick.cmd.cli.YardstickCLI>

).main = <unbound method YardstickCLI.main>

global sys = <module 'sys' (built-in)>

sys.argv = ['/usr/local/bin/yardstick', 'task', 'start', 'tests/opnfv/test_cases/opnfv_yardstick_tc001.yaml']

 /home/opnfv/repos/yardstick/yardstick/cmd/cli.py in main(self=<yardstick.cmd.cli.YardstickCLI instance>, argv=['task', 'start',

'tests/opnfv/test_cases/opnfv_yardstick_tc001.yaml'])

  160             self._handle_global_opts()

  161

  162             self._dispatch_func_notask()

  163         finally:

  164             self._clear_config_opts()

self = <yardstick.cmd.cli.YardstickCLI instance>

self._dispatch_func_notask = <bound method YardstickCLI._dispatch_func_notask of <yardstick.cmd.cli.YardstickCLI instance>>

 /home/opnfv/repos/yardstick/yardstick/cmd/cli.py in _dispatch_func_notask(self=<yardstick.cmd.cli.YardstickCLI instance>)

  138         # dispatch to category parser

  139         func = CONF.category.func

  140         func(CONF.category)

  141

  142     def _dispatch_func_task(self, task_id):

func = <bound method TaskCommands.do_start of <yardstick.cmd.commands.task.TaskCommands object>>

global CONF = <oslo_config.cfg.ConfigOpts object>

CONF.category undefined

 /home/opnfv/repos/yardstick/yardstick/cmd/commands/task.py in do_start(self=<yardstick.cmd.commands.task.TaskCommands object>,

args=<oslo_config.cfg.SubCommandAttr object>, **kwargs={})

   63         else:

   64             LOG.info('Task FAILED')

   65             raise RuntimeError('Task Failed')

   66

   67     def _write_error_data(self, error):

builtinRuntimeError = <type 'exceptions.RuntimeError'>

<type 'exceptions.RuntimeError'>: Task Failed

    __class__ = <type 'exceptions.RuntimeError'>

    __delattr__ = <method-wrapper '__delattr__' of exceptions.RuntimeError object>

    __dict__ = {}

    __doc__ = 'Unspecified run-time error.'

    __format__ = <built-in method __format__ of exceptions.RuntimeError object>

    __getattribute__ = <method-wrapper '__getattribute__' of exceptions.RuntimeError object>

    __getitem__ = <method-wrapper '__getitem__' of exceptions.RuntimeError object>

    __getslice__ = <method-wrapper '__getslice__' of exceptions.RuntimeError object>

    __hash__ = <method-wrapper '__hash__' of exceptions.RuntimeError object>

    __init__ = <method-wrapper '__init__' of exceptions.RuntimeError object>

    __new__ = <built-in method __new__ of type object>

    __reduce__ = <built-in method __reduce__ of exceptions.RuntimeError object>

    __reduce_ex__ = <built-in method __reduce_ex__ of exceptions.RuntimeError object>

    __repr__ = <method-wrapper '__repr__' of exceptions.RuntimeError object>

    __setattr__ = <method-wrapper '__setattr__' of exceptions.RuntimeError object>

    __setstate__ = <built-in method __setstate__ of exceptions.RuntimeError object>

    __sizeof__ = <built-in method __sizeof__ of exceptions.RuntimeError object>

    __str__ = <method-wrapper '__str__' of exceptions.RuntimeError object>

    __subclasshook__ = <built-in method __subclasshook__ of type object>

    __unicode__ = <built-in method __unicode__ of exceptions.RuntimeError object>

    args = ('Task Failed',)

    message = 'Task Failed'

The above is a description of an error in a Python program.  Here is

the original traceback:

Traceback (most recent call last):

  File "/usr/local/bin/yardstick", line 11, in <module>

    load_entry_point('yardstick', 'console_scripts', 'yardstick')()

  File "/home/opnfv/repos/yardstick/yardstick/main.py", line 49, in main

    YardstickCLI().main(sys.argv[1:])

  File "/home/opnfv/repos/yardstick/yardstick/cmd/cli.py", line 162, in main

    self._dispatch_func_notask()

  File "/home/opnfv/repos/yardstick/yardstick/cmd/cli.py", line 140, in _dispatch_func_notask

    func(CONF.category)

  File "/home/opnfv/repos/yardstick/yardstick/cmd/commands/task.py", line 65, in do_start

    raise RuntimeError('Task Failed')

RuntimeError: Task Failed

srupanagunta

Hi, 

The dispatcher type (in /etc/yardstick/yardstick.conf) was not set correctly. It should be set to the string "influxdb", and not the name of the influxdb container (as you seem to have set). 

dispatcher = wizardly_gates

The above should be changed to 

dispatcher = influxdb